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THIS BOOK 


is the first to be devoted exclusively to 
error-detecting and error-correcting codes 
for information transmission and storage 
systems. Some of the material has never 
been published before. 


The first five chapters give an up-to-date 
treatment of coding theory and systems 
known before 1958; the last seven chapters 
discuss more recent developments in terms 
of both theory and implementation. Five 
appendixes provide valuable supplemen- 
tary information, including a table for the 
entropy function and a table of irreducible 
polynomials over GF(2). 


The book tells in detail how to imple- 
ment codes in practical systems. Emphasis 
is on types of codes that have mathematical, 
especially algebraic structure. The math- 
ematics necessary for understanding of cod- 
ing theory is included in the book. 


The book is addressed to engineers who 
require a thorough knowledge of coding. 
Especially helpful for persons working with 
a practical system, it is of interest to all in- 
formation theorists, teachers of information 
theory, data-transmission engineers, and 
computer engineers. 


The book can be used as a text, for first 
and second year information theory courses, 
to supplement more general books on theo- 
retical aspects of the field. 


The author is an associate professor of 
electrical engineering at the University of 
Florida. He received his Ph.D. in electric- 
al engineering from the University of Mich- 
igan in 1954 and working in IBM Engineer- 
ing Laboratories for two years before ac- 
cepting his current academic post. He was 
visiting professor of electrical engineering 


at M.LT. in 1959-60, 
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PREFACE 


The recent developments in the theory of error-correcting codes, 
together with the increasing demand for reliable digital data systems, 
have resulted quite suddenly in the need for a unified treatment of 
coding theory. It is hoped that this book, together with the new one 
by Wozencraft and Reiffen on sequential decoding, can fill this need. 

The book is addressed to the engineer or mathematician who re- 
quires a thorough knowledge of coding, perhaps as background for 
research or for the application of these codes in systems, I have 
selected what seems to me to be the mathematical background es- 
sential for a thorough understanding of coding, and this material 
is presented in Chapters 2 and 6. While the presentation is fairly 
complete, the reader who is unfamiliar with modern algebra may 
find supplementary reading necessary. Then I have attempted to 
keep the presentation within the scope of the mathematics presented 
in these chapters. Thus I have not discussed or used the concepts 
of homomorphism and isomorphism; although they come up and are 
even mentioned at more than one point, they do not seem to me es- 
sential for good insight into coding theory, On the other hand, the 
properties of finite fields are absolutely indispensable for a thorough 
understanding of cyclic codes, even though an introduction to cyclic. 
codes from an elementary viewpoint is possible, as, for example, 
in a recent paper by D. T. Brown and myself, I have avoided a 
simplified treatment wherever it provides less insight into the prob- 
lem, 

As an aid to the reader interested in a specific subject, Appendix 
D lists for each section of the book those sections preceding it 
which are required as background. Appendix E lists symbols and 
notation used throughout the book. I have tried to keep this list 
fairly short and to define most of the symbols locally. 

Although I have tried conscientiously to eliminate errors, some 
will certainly remain in the published book. I should very much 
appreciate hearing about these, and in turn I shall be happy to 
provide an errata list upon request, 

My serious work on coding began in 1955 with J. E. MacDonald 
and A. B. Fontaine at the International Business Machines Corpo- 
ration, and I continued to work with them through consulting and 
summer employment with IBM through 1960, My association with 
M.1.T. and ite Research Laboratory of Electronics, as a Visiting 
Fellow in the spring of 1956 and as a Visiting Associate Professor 
for the academic year 1959-60, greatly stimulated my work on coding. 


vi preface 


Iam indebted to Professor R. M. Fano for the suggestion to 
write this book, and I have enjoyed our comparing notes and our 
race to see whether his book or mine would be finished first — 
the race has ended in a tie. 

I have been fortunate in having the opportunity to discuss many 
aspects of coding with authorities on the subject. I am deeply 
indebted to Eugene Prange for a number of discussions relating 
especially to Chapters 3, 8, and1ll. It was Prange's work that 
first inspired my interest in cyclic codes. N. Zierler and D. 
Gorenstein helped me clear up a number of questions. D. W. 
Hagelbarger made several valuable suggestions relating to Chapter 
12. Ienjoyed stimulating discussions, mostly on cyclic burst- 
error-correcting codes, with N. M. Abramson, C. M. Melas, 
and J. E. Meggitt. I wish to acknowledge also discussions with 
D. T. Brown, R. G. Gallager, and A. B,. Fontaine. 

The computer minimization of the logical circuits in Section 11.1 
was done by J. P. Roth of IBM and T. C. Bartee of M.I. T. Lincoln 
Laboratories, Other computations were made at the IBM labora- 
tories in Poughkeepsie, The M.I.T. Computation Center, and the 
University of Florida Statistical Laboratory. 

The first ten chapters were originally written as class notes for 
a course on information theory at M.I.T. during the spring semes- 
ter of 1960. Both the students and a number of my associates have 
pointed out errors, Particularly helpful errata lists were provided 
by Prange, Fontaine, Gallager, H. Ekre, C. N. Campopiano, and 
J. B. Kruskal. 

The first draft of the first ten chapters was typed by the Research 
Laboratory of Electronics Publications Office under the direction 
of Mrs. Miriam C. Smythe. Their very excellent work greatly 
facilitated the preparation of the final manuscript. It has beena 
real pleasure to work with the staff of The M.I.T. Press, and 
especially Miss Constance D. Boyd, who has painstakingly edited 
the manuscript. Last but not least, my wife has read the manu- 
script for language errors, and in addition she and my children 

have cheerfully tolerated my constant preoccupation during this 
long year of writing. Without the help of all these people this book 
would have been impossible, and I am deeply grateful to all of them. 


Gainesville, Florida W. Wesley Peterson 
January, 1961 
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Chaptex i 


THE CODING PROBLEM 


During the past two years there have been several remarkable 
developments in the construction of error-correcting codes. Meth- 
ods of constructing efficient, very long codes have been devised; 
furthermore, these codes meet the essential requirement that they 
can be implemented practically. At the same time there is a grow- 
ing need for communication channels of extreme reliability for use 
with computers and automation equipment. As the need grows for 
greater reliability, as electronic logical devices become more eco- 
nomical to produce, and as our understanding of coding grows, the 
time approaches when the type of error-detection and error-~correc- 
tion systems described in this book will play an important role in 
the success of complex systems. 

This chapter introduces the concept of a communication channel, 
describes the role of codes in communication, and defines block 
codes and other fundamental concepts. 


1.1, The Communication Channel 


A block diagram of a digital communication system is shown in 
Figure 1.1.8° The same model describes an information storage 
system, if the storage medium is considered to be a channel. A 
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Figure 1,1, Block diagram of a general data communication 
or storage system 


typical transmission channel is a telephone line. A typical storage 
device is a magnetic-tape unit including writing and reading heads. 
The source information is typically messages of binary or decimal 
digits or alphabetic information in some form. The encoder trans- 
forms these messages into signals acceptable to the channel — 
typically electrical signals with some restrictions on power, band- 
width, and duration, These signals enter the channel and are per- 
turbed by noise, The output enters the decoder, which makes a 
decision concerning which message was sent and delivers this mes- 
sage to destination, The communication engineering problem is 
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principally to design the encoder and the decoder, though it may 
also include improving the channel. Note that the encoder includes 
what is usually called modulation and the decoder includes detection. 

The system described in Figure 1.1 is too general to be handled 
effectively in theoretical analyses. General theory indicates that 
such a channel has a definite capacity, and that typical sources 
have a definite rate; and that if the rate of the source is less than 
the channel capacity, it is possible to encode and decode in such 
a way that the probability of erroneous decoding is arbitrarily 
small.33? 34: 67,101,102 This theory gives hope for the future but no 
more than vague indications at the present as to how a data trans- 
mission system should be designed. 

A typical system of the present is shown in Figure l. 2. Informa- 
tion is almost universally handled with a machine in binary form 
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Figure 1.2. Block diagram of a typical data 
communication or storage system 


and is converted at the input to binary. Many systems use a code 
in which various combinations of six binary digits represent each 
of the numerals, letters, a space, and various special symbols 
such as punctuation, Another common combination is a code using 
four binary digits for each decimal digit and two decimal digits for 
alphabetic or special characters. me 

The binary-to-channel encoder is what is sometimes called a 
modulator. Typically it encodes a 1 into a pulse anda 0 into 
either no pulse or a pulse readily distinguishable from the code 
tor i. This handling of a single binary symbol at a time in the 
channel encoder is a restriction that definitely causes the loss of 
channel capacity. The channel-to-binary decoder makes a decision 
for each received pulse to determine whether a 1 or a 0 was 


transmitted, The independent decoding of individual pulses results 
in a further loss of channel capacity, Theory shows that more 
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complex encoding and decoding would make possible transmission 
at higher rates with the same probability of error, but no effective 
practical way to accomplish this is yet known-* 

The binary-to-binary encoder and decoder implement binary 


error-detecting or error-correcting codes. 


1.2. Some Remarks on Binary Error-Detecting and Error- 
Correcting Codes 


In an ideal system the binary symbol that comes out of the chan- 
nel-to-binary decoder should match the symbol that entered the 
binary-to-channel encoder. Ina practical system there are occa- 
sional errors, and it is the purpose of binary codes to detect and 
perhaps correct such errors. These codes cannot correct every 
conceivable pattern of errors but rather must be designed to cor- 
rect the most likely patterns of errors. Much of binary coding 
theory has been based on the assumption that each symbol is af- 
fected independently by the noise, and that therefore the probability 
of a given error pattern depends only on the number of errors. 
Thus, for example, codes have been developed that correct any 
pattern of t or fewer errors ina block of n symbols. While 
this may be the appropriate model for some channels, on telephone 
lines and on magnetic-tape storage systems errors occur predom~ 
inantly in bursts. Telephone-line disturbances, such as lightning, 
last longer than the time for one symbol. Furthermore, magnetic- 
tape defects are larger than the space required for a symbol. Con- 
sequently, codes for correcting bursts of errors are required, and 
some remarkably good codes, described in Chapters 10 and 12, 
have been developed for this purpose. 

The communication channels shown in Figures 1.1 and 1.2 are 
strictly one-way channels. Very frequently communication sys- 
tems are two-way channels, a fact that must be considered in de- 
signing codes. With a two-way channel, for example, an error- 
detecting code can be used. When an error is detected at one 
terminal, a request for repeat can be given, and thus errors can 
effectively be corrected. 

There are true examples of one-way channels, in which error 
probabilities can be reduced with error-correcting codes but not 
by error detection and retransmission. With a magnetic-tape 
storage system, for example, it is too late to ask for a retransmis- 
sion after the tape has been stored a week or a month, and errors 
are detected when the record is read, Encoding for error-correct- 
ing codes is very little more complex than for error detection. It 
is the decoding that is likely to require complex equipment. For 
transmission from a satellite, for example, where the amount of 
equipment at the transmitter is much more important than the 
total amount of equipment, the encoding equipment for an error- 
correcting aysatem ia likely to be more practical than provision 


| ol 
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for remotely controlled retransmission. The complex error- 
correction procedures can be performed on earth, where equip- 
ment limitations are not severe. Hence there are system problems 
that call for error-correcting codes requiring no feedback. 

On the other hand, error detection is by its nature a much sim- 
pler task than error correction; and when a two-way channel is 
available, error detection combined with provision for a request 
for retransmission will usually be found more feasible than the 
error-correcting codes known at the present. 3? Some codes, espe- 
cially the burst-error-correcting codes discussed in Chapter 10, 
implement so well that, even when there is a provision for retrans-~ 
mission, limited error correction might well be built into the sys- 
tem to reduce the number of retransmissions required. 

The efficient use of feedback in error control has not received 
the attention it deserves in coding theory. Certainly feedback can 
greatly simplify error correction. Yet there is a definite limit to 
the efficiency of a simple error-detection and retransmission sys- 
tem, for short error-detection codes cannot efficiently detect 
errors, while if extremely long codes are used retransmission 
must be performed too frequently. Little is known about use of 
the feedback channel in any more sophisticated way 77229 


1.3. Block Codes 


Except in Chapter 12, all the codes presented in this book are 
block codes. It was also for block codes specifically that Shannon 
proved his fundamental theorem for the discrete noisy channel, 1° 
which states that a channel has a well-defined capacity and that by 
using suitable codes it is possible to transmit information at any 
rate less than the channel capacity with arbitrarily small proba- 
bility of error in the decoding decision. Such codes find applica- 
tion not only in the communication channel but also in at least two 
other areas: They are the basis for the load-sharing switching 
matrix, 20) 24,77,110 Which is not only more efficient than conventional 
memory addressing systems but does some automatic correction 
for component failures, and they are the same in mathematical 
structure as some statistical experimental designs.?’7° 

A block code is a code that uses sequences of n channel symbols, 
or n-tuples. Only certain selected n-tuples, called code blocks or, 
more commonly, code words, are transmitted. At the receiver a 
decision is made, on the basis of the information in the received 
n-tuple, concerning the code word transmitted, This decision is 
a statistical decision; that is, it is of the nature of a best guess 
on the basis of available information but would not be infallible. 
With a good code, the probability of a wrong decision may be much 
smaller than the probability that the original channel input symbols 
are reproduced without error at the channel output, 
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The decision process can be defined mathematically bya decoding 
table. The code words make up the first row of the table. If a code 
word is received, it is logical to assume the same code word was 
transmitted. The decision of the receiver for other possible re- 
ceived words is described by listing under each code word the received 
words that would be decoded into it. Thus every possible received 
word appears once and only once in the decoding table. 


Example: Suppose that there are four possible messages, a, 

b, c, and d, and that a message is to be transmitted using 

a binary block code of length five. Then four code words must 

be chosen, say 11000 for a, 00110 for Deg. dl0LO aly tor 
Cuyeandw01els0.d stogmede; ulhen also the decision of the receiver 
must be described for each of the 25 = 32 possible received 
words, or 5-tuples. An example of how this might be done is 
shown in Figure 1.3. 


Code Words. 1. 1000.0:...000.321:00. Tamebone Ooi tae 
11001 OTT! FOO KOO Nee 
PO PO 6 PEO PRS CT 

Sins iT ee wvtre Tet? Se oo 

Received 

wacked 1B. G8: Ot ba By Heke hak eee Oo 
ey OR Odes Oo Pa Mra 
7771710700000 010171 10101 
eaoraia ore ide 29 Vd: OO) 


Figure 1.3. Decoding table for binary code 


The code and decoding scheme shown in Figure 1. 3 decode 
correctly if the received word has no more than one error, 
that is, no more than one altered symbol, since each of the 
five words that would result from a single error are listed 
below each code word. Certain other error patterns are de- 
coded correctly, while still others result in errors. For 
example, if 11000 is transmitted, and two errors occur, 
resulting in reception of 11110 , it will be decoded cor- 
rectly, since 11110 is in the column under 11000 
If two errors result in 11011 , however, it will be decoded 
incorrectly into 10011 , since 11011 is in the column 
under 10011 in Figure 1.3. 


The decoding might allow, as an alternative, to state that an 
error is detected but not to guess which code word was transmitted. 
This might take the form of an error-detection system, in which 


; 
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the binary-to-binary decoder signals detection but attempts no 
other decision if other than a code word is received. Alternatively, 
it might combine error detection and correction. For example, 

for the code shown in Figure 1.3 any received word above the 
dashed line might be decoded into the code word at the top of the 
column, but the decoder might merely signal "error detection" for 
received words below the dashed line. This would correspond to 
single-error correction with detection of some combinations of two 
or more errors. 

In order to predict the performance of a code, it is necessary to 
have precise information about the channel. Though many real 
communication channels are not accurately represented by it, the 
binary symmetric channel, shown in Figure 1.4, has been studied 
extensively. For it, the probability is Q that the same symbol 
as transmitted will be received, and the probability is P=1-Q 
that the opposite symbol will be received. It is assumed that 
Q>P and that each symbol is independent of all others. Note 
that this ''channel" includes the binary-to-channel encoder, the 
channel, and the channel-to-binary decoder of the typical system 
shown in Figure 1. 2. 

Another idealized channel that has been studied extensively is 
the binary erasure channel, shown in Figure 1.5. For it, the 
probability is Q that the same symbol will be received as was 


Figure 1.4, The binary sym- Figure 1.5. The binary erasure 
metric channel channel 


transmitted. The probability is P=1-Q that a transmitted 
symbol] will be erased. (An erasure is indicated by an X.) The 
symbols are assumed to be affected independently. Note that with 
this channel the locations of perturbed symbols are known, and 
usually this fact makes correction of erasures easier than correc- 
tion of errors, Generalizations of the erasure channel include a 
nonbinary erasure channel and a channel with both erasures and 
errors. The erasure channel is an idealization of a system in 
which the channel-to-binary decoder shown in Figure 1. 2 is de- 
signed to deliver the erasure symbol rather thana 1 or O in 
doubtful cases, 

Now if the binary symmetric channel is assumed, and if a par- 
ticular code word is tranamitted, the probability that no error will 
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occur is Q”. The probability that one error will occur in a speci- 
fied position is PQ": ovERe probability for a particular received 
word that differs from the transmitted word in i positions is 
P'Q™"*. since Q>P, the received block with no errors is more 
likely than any other. Any received word with one error is more 
likely than any with two or more errors, and soon. In this case, 
for an assumption that all the code words are equally likely to be 
transmitted, the best decision at the receiver would be always to 
decode into a code word that differs from the received word in 
the fewest positions. Such decoding is called maximum-likelihood 


decoding. The decoding in Figure 1.3 satisfies this criterion. 
Again for an assumption of the binary symmetric channel, prob- 


ability of correct decoding can be calculated in the following way 
for the code shown in Figure 1.3. Suppose that 11000 is trans- 
mitted. It will be decoded correctly if any word in its column is 
received. One of these words differs in no positions, five differ 

in one position, and two differ in two positions. The probability 

of correct decoding is then 


P(correct decoding) = 1P°Q® + 5P? Q* + 2P7Q° 


Similar calculations can be made for the other code words. 

If this code is used for straight error detection, the probability 
of correct reception is Q*. The probability of an undetected error 
if 11000 is transmitted is the probability that another code word 
is received if 11000 is transmitted. Since one code word differs 
in four positions and the other two in three positions each, 


P( undetected error) = 1P*Q + 2P°Q? 
1.4. Hamming Distance 


The concept of Hamming distance® is useful in discussing the 
error-correcting ability of codes. The Hamming distance be- 
tween two words is defined to be the number of positions in which 
the words differ. Thus a single error results in a Hamming 
distance 1 between transmitted word and received word. Ifa 
code is used as a straight error-detecting code to detect all 
patterns of d or fewer errors, it is necessary and sufficient for 
the minimum Hamming distance between code words to be d+ l, 
for, if the distance is d+ 1, no pattern of d errors can alter one 
code word into another, while if the minimum distance is d or 
less, there exists some pair of words at distance say d' $d, and 
then there is a pattern of d' errors which will carry one into the 
other. 

Similarly, it is possible to decode in such a way as to correct 
all patterns of t or fewer errors if and only if the minimum distance 
between code words is at least 2t +1, Then any received word 
with t! St errors differs from the transmitted code word in t! 
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symbols but from every other code word in 2t +1 - t’ >t! symbols. 


On the other hand, if the minimum distance is less, there is at 
least one case where a t-fold error results in a received word at 
least as close to an incorrect code word as to the transmitted code 
word. Finally, by a similar argument it can be seen that it is 
possible to decode in a way that corrects all combinations of t or 
fewer errors and simultaneously detects all combinations of d or 
fewer errors (d = t) if and only if the minimum distance between 
code words is t+d+l. 


1.5. The Coding Problem 


For codes to be very effective they must be long, so as to 
average the effects of noise over a large number of symbols. Such 
a code may have TORE? possible code words and many times this 
number of possible received words. While the code and decoding 
are still conceptually described by a table such as that shown in 
Figure 1.3, it becomes impossible to construct such a table, or 
even to list the code words. Mathematical structure can enable 
us to find its properties. Even more important, such structure 
can make it feasible for the encoding and decoding operations to be 
implemented in electronic equipment. 

Thus there are three essential phases of the problem: (1) To 
find codes that have the required error-correcting ability. This 
usually requires that the codes be long. (2) To finda practical 
method of encoding. (3) To find a practical method of making the 
decision at the receiver, that is, a method of error correction. 
The typical attack on the problem has been to find codes that could 
be proved mathematically to satisfy the required error-correcting 
ability. These codes must have mathematical structure to make 
even this possible. This mathematical structure is then exploited 
to meet the other two requirements, ability to code and to decode. 
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NOTES 


While the principal purpose of this book is to treat error-correcting codes, 
error detection, including combined error detection and error correction,is 
also discussed. The error-detecting ability of a code is closely related to its 
ability to correct errors, and it is only natural to consider both properties 
together. 

Nearly all present-day equipment is binary, and therefore binary codes 
are of the greatest importance now. In most cases codes can be generalized 
to the case of q symbols, where q is any power of any prime number, with 
very minor changes in descriptions, derivations, and proofs. This more 
general case is important: In the first place a nonbinary code may be used 
with nonbinary information — decimal information can be represented quite 
efficiently ina q=11 code, for example. Second, new binary codes can be 
constructed from nonbinary codes, especially those for which q is a power 
of 2. The general case is treated in this book wherever it does not encum- 
ber this presentation. The reader who is interested only in binary codes 
can merely replace q by 2 and the words ''field element'! by ''binary symbol"! 
as he reads. 

While only Hamming distance®® is used in this book, at least one other dis- 
tance function, Lee distance/®93,11 has been used in coding theory, Lee dis- 
tance and Hamming distance coincide in the binary case. 

The emphasis in this book is on codes whose basic structure is algebraic. 
The most impressive recent developments are in this area. Some codes 
based on geometric ideas are discussed in Chapter 5. An approach that is 
difficult to assess at the present is the use of random codes, Shannon's proof 
of the fundamental coding theorem for the noisy channel and, indeed, many 
similar results derived since then are based on the calculation of average 
properties of a large class of codes. There is every reason to believe that 
the best of several codes chosen randomly from a class of codes will be at 
least as good as average. Random coding methods with effective decoding 
procedures have been devised by Gallager*® and Wozencraft,!!* 141 and in 
both cases computer simulation has been very encouraging. These results 
are discussed very briefly in Chapters 11 and 12, respectively. 

The problem of coding messages into continuous signals and thereby utiliz- 
ing the full capacity of a continuous channel has received some attention 
lately, and our understanding of the continuous channel now is comparable 
with our understanding of the discrete channel about five years ago. Sepa 
Some progress has been made also in the understanding of the use of a two- 
way channel. °*»??° 

Almost invariably, for any result pertaining to an error channel (such as 
the binary symmetric channel), an analogous result exists for an erasure 
channel. Many of these are given as exercises. A few — notably the use of 
a binary Bose-Chaudhuri code with a channel with errors and erasures — are 
presented in the text. Elias introduced the concept of an erasure channel, oe 
and virtually all the results presented in this book on erasure channels are 
directly or indirectly attributable to him, Decoding for the erasure channel 
has been studied by Epstein,’* 

An excellent general introduction to communication theory has just been 
completed by Fano,* and this book contains many important results relating 
to coding theory that are otherwise available only in journal articles if at all. 
Shannon's classic original paper'’ (a atill a good reference, For mathemat- 
ically inclined reader, Feinstein'e®* hae much to recommend it, The sim- 
pleat presentation available in book form ta Goldman's, a 


10 error-correcting codes 


PROBLEMS 


1.1, Form a maximum-likelihood decoding table for the binary code con- 
sisting of the four code words 0000 , 0011, 1100 , and 1111: 


a. Assuming the binary symmetric channel. 
b. Assuming the binary erasure channel. 


1.2, A''metric' function is defined as a real-valued function having the 
following three properties: 


A: d(x, x) = 0 (reflexive) 
By dec. ¥) ‘=ad(y0) (symmetric) 
Cs d(x, y) = :dy,.z) +:d(x,, 2) (triangle inequality) 


Show that Hamming distance is a metric function. 


1.3. Suppose that the set of all transmitted messages x, y, ... is S, 
and that a metric function d(x, y) is defined on this set S . Suppose that re- 
ceived messages are in the same set. If x is transmitted and y received, 
an error of magnitude d(x, y) is said to have occurred. A code C isa 
subset of S , the idea being that in using a code C , only messages 
Mya Koen s02 ih C are transmitted. 


a. Show that a code C is capable of detecting any error of magnitude 
d or less if and only if the distance between messages in the code C 
is greater than d 

b. Show that a code is capable of correcting any error of magnitude t 
if and only if the minimum distance between code messages is 
greater than 2t. 

c. Show that a code can correct errors of magnitude t and simultane- 
ously detect errors of magnitude d2t if and only if the minimum 
distance between code messages is at least t+d+1 


1.4. Show that if a code with minimum Hamming distance e + 1 between 
code blocks is used with an erasure channel it is possible to decode in such 
a way as to correct all combinations of e or fewer erasures but not all 
combinations of e + 1 erasures. 


1.5. Show that minimum Hamming distance at least 2t + e + 1 between 
code blocks is necessary and sufficient for correcting all combinations of 
t errors and e erasures. 





Chapter 2 
INTRODUCTION TO ALGEBRA 


Structure is desirable in error-correcting codes for two rea- 
sons: It facilitates finding properties of a code, and even more 
important it makes instrumentation of the codes practical. 
Algebraic structure has been the basis of the most important 
known codes. 

This chapter consists of two parts. The first defines the most 
significant algebraic structures and gives a few examples of each. 
The rest of the chapter reviews some of the theory of vector 
spaces and matrices. Chapter 6 is also purely mathematical, 
dealing with the theory of rings and finite fields. These two chap- 
ters are in no sense complete mathematical presentations but 
rather barely minimum mathematical prerequisites for the dis- 
cussion of codes. 

Algebraic systems are systems that satisfy certain rules or 
laws, and for the most part, these are the same laws as apply to 
our ordinary number system. Thus a group is a system with one 
operation and its inverse, such as addition and its inverse sub- 
traction, or multiplication and its inverse division. A ring has 
two operations, addition and multiplication, and the inverse 
operation, subtraction, for the first. A field has the two opera- 
tions, both with inverses. 





oh eae 


A group G isa set of objects, or elements, for which an 
operation is defined and for which Axioms G.1 to G.4hold. Let 
a, b, Sc; be elements of the group. The operation is a single- 
valued function of two variables, and might well be denoted 
f(a, b) = c but is customarily denoted a+b=c or ab=c, and 
called addition or multiplication even though it may not be the 
addition or multiplication of the arithmetic of ordinary numbers. 


Axiom G,1 (Closure). The operation can be applied to 
any two group elements to give a third group element as 
a result. 


Axiom G.2 (Associative Law), For any three elements 
a, b, andc of the group, (a+b) +c =a+t(b+c) if the 
operation is written as addition, or a(be) = (ab)c if the 
operation is written as multiplication, 
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The associative law means that the order of performing opera- 
tions is immaterial, and so parentheses are unnecessary. 


Axiom G.3 There is an identity element. 


If the operation is called addition, the identity element is called 
zero and written 0 , and is defined by the equation 0+a=a+0=a 
for every element a of the group. If the operation is called mul- 
tiplication, the identity is one, written 1 , and is defined by the 
equation la=al=a. 


Axiom G.4 Every element of the group has an inverse element. 


If the operation is addition, the inverse element corresponding 
to a is denoted -a and is defined by the equation a + (-a) = 
(-a)+a+=0 . If the operation is multiplication, the inverse of a 
is denoted a! and is defined by the equation aa! =a 'a=1 

In addition to the above laws, a group may satisfy the commu- 
tative law; thatis, at+b=bta _, orif the operation is multipli- 
cation, ab =ba. Such a group is called Abelian or commutative. 

In developing a general theory of groups, the multiplicative no- 
tation is used in this book, 


Theorem 2.1. The identity element in a group is unique, and 
the inverse of each group element is unique. 


Proof: The identity element is unique, for if there were two 
identity elements, 1 and 1', (1)(l'‘)=1z2I1' . Similarly in- 
verses are unique, for if a group element g were to have two in- 
verses g ' and g,! , then g = 1g"! : hs 


=g: se =e 128," 
so that they must be equal. 


QED 


Note that the inverse of a product is the product of inverses in 
reverse order, for (ab) (baan?)) = a(bb7!) a7! sala"! saa"! =] ” 
and therefore b +a! = (ab)! 


Examples: The set of all real numbers is a group under the 


operation of ordinary addition. The set of all positive and nega- } 


tive integers and zero is also a group under addition. The set 
of all real numbers excluding zerois a group under the opera- 
tion of ordinary multiplication. All these groups are Abelian. 
The set of all nonsingular n Xn matrices is a non-Abelian 
group, under the operation matrix multiplication. 

Many important groups are sets of transformations of some 
space, with the operation called multiplication, defined as fol- 
lows: The transformation ab is the result of performing the 
transformation b followed by the transformation a . For 
example, the set of rotations of n-dimensional Euclidean space 
is a group. Note that the rotations of two-dimensional space 
form an Abelian group, while the rotations of three-dimensional 
space are not commutative, 
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As a first example of a finite group, consider all the linear 
transformations of a plane which map a square onto itself. A 
transformation is completely determined if its effect on the four 


vertices is specified. B 


D C 


For example, one possible mapping is a 90° counterclockwise 
rotation of the square, which maps A onto D, B onto A, C 


onto B_ , and D onto C . It can be described in the notation 
sometimes used for permutations: 

ABCD 

DABC 


There are eight such transformations in all: 
ABCD _ (ABCD » = (ABCD Foca 
Ys Vasop gd? * MARC). |”. \GDAee BCDA 


ABCD _ [ABCD ; = (ABCD g = (2300) 
ee Cig CUR fe 9°, ACAREE CBAD 


The multiplication table is 

















The fact that each element has an inverse can be easily seen 
from the multiplication table. Although the associative law 
could be verified from the multiplication table, this would be a 
very tedious job, but it should be clear from the definition of the 
group that the associative law does hold, 

There is a group with only one element, That element must 
be the identity element by Axiom G, 3, and it is easy to verify 
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that the other axioms hold. There is also a group with two ele- 
ments. One must be the identity element, 0 . Let us call the 
other element a . Then a must have an inverse, and since 
a+O=a#0, -a#0,s0 -a=a . Thus the addition table must 
be 0+0=0, Ota=at+tOza,at+a=0, anda set of two ele- 
ments with addition defined in this way satisfies all the axioms 
G.1 to G.4. In fact, the only group with two elements is also 
Abelian. 





2.2. Rings 


A ring R is a set of elements for which two Operations are de- 
fined. One is called addition and denoted a+b , and the other is 
called multiplication and denoted ab , even though these opera- 
tions may not be ordinary addition or multiplication of numbers. 
In order for R to be a ring, the following axioms must be satis- 


fied: 
Axiom R.1 The set R is an Abelian group under addition. 


Axiom R.2 (Closure). For any two elements a and b of Re 
the product ab is defined and is an element of R 


Axiom R.3 (Associative Law). For any three elements a , 
Detguand: (Cc -OfoR. |. “albe) = ab)e 


Axiom R.4 (Distributive Law). For any three elements a , 
b , and c of R , a(b+c)=ab+ac and (b+c)a=batca. 


A ring is called commutative if its multiplication operation is 
commutative; that is, if for any two elements a and b , ab=ba. 


Theorem 2.2. In any ring, for any elements a and b , 
a0 = 0a =0 and a(-b) = (-a)b = -(ab) 


Proof: In any ring, by Axiom R.4, for any a , a(0+ 0) =a0 +a0. 


But since 0+0+0, a0 =a0+a0 . Next a0 must have an addi- 
tive inverse, and adding this to both sides gives 0 = a0 + (-a0) = 
a0 +a0+(-a0) =a0+0=a0 , soinanyring a0=0 . Similarly 


0a=0 . Then 0 = a0 =a(b + (-b)) =ab+a(-b) , so a(-b) = -(ab) . 


Similarly (-a)b = -(ab) 
QED 


Examples: The set of all real numbers is a ring under the opera- 
tions of ordinary addition and multiplication. The set of all posi- 
tive and negative integers and zero is also a ring under ordinary 
addition and multiplication. Both these rings are commutative. 
The set of all n Xn matrices with either integer or real-number 
elements is a ring under the operations matrix addition and 
matrix multiplication, and this ring is noncommutative. The set 
of all polynomials in one indeterminant, or variable, with integer 
coefficients is a commutative ring, 
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A set consisting of a zero element only is a ring, with the 
rules 0+0=0, (0)(0)=0 . There are two different rings 
with two elements. One element must be the additive identity 
0 . The other element a must satisfy a+az=0O . Since 
(0)(0) = Oa = a0 = 0 by Theorem 2.2, the only question is, what 
is the value of aa? It turns out that either aa=a or aa=0 
satisfies both the distributive and associative laws, and thus 
either choice gives a ring, and clearly these two choices give 
rings of different structure. 


A field is a commutative ring with a unit element (multiplicative 
identity) in which every nonzero element has a multiplicative in- 
verse. 

A noncommutative ring in which every nonzero element has an 
inverse is usually called a division ring or a skew field. 

Note that the nonzero elements of a field satisfy all the axioms 
for a group and thus form a group under the operation multiplica- 
tion. 


Examples: The set of all real numbers form a field, as do also 
the set of all rational numbers and the set of all complex num- 
bers. 

The minimum number of elements a field could have is two, 
for it must have both an additive identity 0 anda multiplicative 
identity 1 . They would have to satisfy the addition and multi- 
plication tables given in Table 2.1, for there is only one possible 


Table 2.1. Addition and Multiplication Tables for 
the Field with Two Elements 


tu), 0 sak 
ONroF =k 
Tales 20 





addition table for a group of two elements. Also, it was shown 
that for rings in general, Oa =0 for any a , and, since 1 is 
a unit element, (1)(1) = 1 . It can be verified easily that the set 
0 and 1 with the operations defined above satisfy all the 
axioms for a field. 

It can be shown that for every number q that is a power ofa 
prime number there is a field with q elements. The proof of 
this fits in better with the material of Chapter 6, and is pre- 
sented there, However, it might be well to point out here that a 
field with p elements can be formed by taking the integers 
modulo p , provided p is a prime, The integers modulo q 
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q=p™ elements (m> 1) are not formed by taking integers 
modulo q_. For use in examples, addition and multiplication 
tables for fields with three and four elements are given in Tables 
2.2and 2.3. The field of four elements described in Table 2. 3 
is not the integers modulo 4. 


Table 2.2. Addition and Multiplication Table 
for the Field with Three Elements 





Table 2.3. Addition and Multiplication Table 
for the Field with Four Elements 





2.4. Subgroups and Factor Groups 


A subset of elements of a group G is calleda subgroup H if it sat- 
isfies all the axioms for a group itself. To determine whether H is 
a subgroup, it is necessary only to check for closure (that is, if a and 
b are in H , then ab must be in H ) and for inverses (that is, if a is 
in H,then a7! must be also). If a set is closed under the group opera- 
tion and the inverse is present, the identity must be present also, and 
the associative law must hold in the subgroup if it does in the group. 


Example: In the group of eight transformations of a square given 

previously, the sets (1, a, b, c) and (1, d) are both subgroups.. 
In the group of all integers, the set of all integers that are 

even multiples of a given integer m is a subgroup for every m. 


Suppose that the elements of a group G are gy; , g2, g3,.- 
and the elements of a subgroup H are h, , hz, h3,..., and 
consider the array formed as follows: The first row is the sub- 
group, with the identity at the left and each other element appearing 
once and only once. The first element in the second row is any ele- 
ment not appearing in the first row, and the rest of the elements are 
obtained by multiplying each subgroup element by this first element 
on the left, Similarly a third, fourth, and fifth row are formed, each 
with a previously unused group element in the first column, until 
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all the group elements appear somewhere in the array. 


hy = Die h2 F h3, nae Aah fa" hy 

witht ey ees er he, ‘ei hay  eihy,’) "2. yeah 
Baby ="geeeeehss S2hs,, seh ay Boy 
8mm = 8m B8mbhz, 8mh3, Smhs, ---, Smbn 


The set of elements ina row of this array is called a left coset, 
and the element appearing in the first column is called the coset 
leader. Right cosets could be similarly formed. 





Theorem 2.3. Two elements g and g' of a group G are in the 
same left coset of a subgroup H of G if and only if g™!g!' is an 
element of H 


Proof: If g and g' belong to the coset whose leader is gj, then 
g= 8ihj for some j , g' = gjh, for some k , and gigts= (gjhj)~" 
gihk = hj Tia gih, = bs hy, , which is in the subgroup. On the other 
hand, if g = gjh , where g; is the coset leader, and if eae g'= h', then 
g' = gh' =g;hh', whichis in the samecoset, sincehh' is in the subgroup. 

QED 
Theorem 2.4. Every element of the group G is in one and 
only one coset of a subgroup H 


Proof: Every element appears at least once, by the definition of 
the construction of the array. It must be shown that each element 
appears only once in the array. Suppose first that two elements 
in the same row, gihj and g;h, are equal. Then multiplying each 
on the left by g°" would give hj =h, , a result that is a contra- 
diction, since each subgroup element was assumed to appear only 
once in the first row. Now suppose that two equal elements appear 
in different rows, gjhj = g,hg , and suppose that i>k . Then 
multiplying on the right by hy” gives gj = gxhghj~" . Since 
hg hj7! is in the subgroup, this indicates that g; is in the kth 
coset, a situation that contradicts the rule of construction that 
coset leaders should be previously unused. QED 


The number of elements in a group is called the order of the 
group. The number of cosets of G with respect toa subgroup H 
is called the index of G over H . Clearly, 


(Order of H) (index of G over H) = (order of G) 


A subgroup H of a group G is called normal if, for any element 
h of H andany element g of G , g7' hg is in H . In general, left 
cosets may not be right cosets, and vice versa, However, every left 
coset of 4 normal subgroup is alsoa right coset, and vice versa. In 
anAbelian group, every left coset ia trivially a right coset, and also 
all subgroups are trivially normal, In this book the only use made 
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of normal subgroups will be for Abelian groups, and therefore the 
above result will not be proved in general. 

If a subgroup H of a group G is normal, it is possible to de- 
fine an operation on cosets to form a new group for which the co- 
sets are the elements. This group is called the factor group and 
denoted G/H . The coset containing g is denoted {g} . The 
definition of multiplication for cosets is 


{g, } {g2} = {gi B2 } 


This is not a valid definition unless it happens that, no matter which 
element is chosen as a representative of each of the two cosets to 
be multiplied, the resulting coset is the same. In other words, it 
must be shown that if g, and g,' are in the same coset, and 2 
and gz! are in the same coset, then g;g, and g,'g)' are also in 
the same coset. Assume that gj'g;! =h, , go'g2.! = hz , andthen, 
since the subgroup is normal, g,'-!h, gz’! must be an element of H, 
say hy . Hence (g; g2)~* gi'gz' = g2~* gi’ g1'g2' = g2 ~' hi g2' = g2 ‘gh; = 
hzhg , which is an element of H . Therefore gigz and gy'g,' are 
in the same coset, and the definition is consistent. 

Now let us check that G/H is actually a group. The operation 
is clearly defined for all pairs of cosets, and therefore Axiom G, 1 
is satisfied. To check the associative law, note that 


{g1} ({g2 } {gs}) = {g1} 2 83) = (gigzgs} = {eig2} {g3} = ( {gi} {g2}) {gs} 


The identity element is the subgroup itself, H = {I} , since {1} {}= 
{1g} = {g} and {g} {I} = {gl} = {g} . Similarly the inverse coset of {g} 
is the coset containing g~' , {g-!} since {g}{g~!} = {gg-1} = {1} and 
{g~"} {g} = (g-'g} = {1} . Also if the original group is Abelian, it is 
easily verified that the factor group is also. 


Examples: Suppose that the group G is the group of eight 
transformations of the square, and Hy is the subgroup consist- 
ing of 1, a,b,c. Then the standard array of left cosets is, 
if d is chosen as the coset leader, 

1 a b Cc 


d da =g db =f devas 


There is only one coset consisting of all the elements of G ex- 
cept those in H, , and so this must also be a right coset, and 
H, must be normal. If the identity coset is called I and the 
other one D , then the multiplication table is II=I ID = 
{1} {d} = (d) =D, DI=D, DD = {@} {fd = {ad} = AD }emeals Ger hie, Of 
of course, has the same structure as the only group of twoelements. 
As amore important example, let G be the group of all posi- 
tive and negative integers and zero under addition, and let H be 
the subgroup that consists of all multiples of an integer n . All 
the numbers from zero to n+ 1 inclusive are in different cosets, 
since, for two elements a and b to be in the same coset, 
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(-a) + b must be in the subgroup, and thus be a multiple of n 
These can be taken as coset leaders, and it is easily seen that 
there are no other cosets. Since G is Abelian, addition of 
cosets can be defined, and the cosets form a group. For ex- 


ample, let n=3 . Then the cosets are: 
OV» 23); Men oeecOn te sory FO Sy, 
Tee ay Ne2ae ty oe Ome sos 
Pps DO Gy ee Oo, See ee My el 


If these are called {0} {1} and {2} , respectively, the addition 
table is 


{2} 
{2} 
{0} 
{1} 


This may be recognized as addition modulo 3. 





2.5. Vector Spaces and Linear Algébras 


A set V of elements is called a vector space overa field F if 
it satisfies the following axioms: 


Axiom V.1 The set V is an Abelian group under addition. 


Axiom V.2 For any vector v andany field element c , a 
product cv , which is a vector, is defined. (Field elements 
are called scalars.) 


Axiom V.3 (Distributive Law). If u and v are vectors in 
V ‘and c is-a scalar, c(u.+v)'=‘cu +'cv 


Axiom V.4 (Distributive Law). If v is avector and c and 
d are scalars, (c + d)v =cv + dv 


Axiom V.5 (Associative Law). If v is a vector and c and 
d are scalars, (cd)v =c(dv) , and Iv =v 


A set A of elements is called a linear associative algebra over 
afield F if it satisfies the following axioms: 


Axiom A.1 The set A is a vector space over F 


Axiom A.2 For any two elements u and v of A , there is 
a product uv defined that is in A 


Axiom A.3 (Associative Law), For any three elements u, 
v, and w of A , (uv)w # u(vw) 


Axiom A,4 (Bilinear Law), Moc and d are scalars in F 
and u, v, and w are vectora in A , then 
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u(cv + dw) = cuv + duw and (cv + dw)u = cvu + dwu 


An n-tuple over a field is an ordered set of n field elements, 
and is denoted (a, , az , a3 ,.. »4n) , where each aj is an ele- 
ment of the field. Addition of n-tuples is defined as follows: 


(An gedatssutap)) delbres Dob js is) Da) Cay +b, , ag+ bz,..., an +b) 


Multiplication of an n-tuple by a field element is defined as fol- 
lows: 


Slaeiit dour. ono an) =(ca, , cag ,..., cay) 


With these two definitions it can be verified easily that the set of 
all n-tuples over a field form a vector space, and such vector spaces 
play a central role in coding theory. They are the subject of the 
remainder of this chapter. 

Multiplication of n-tuples can be defined as follows: 


Se a ee ee by) = (aib; , azbz ,..., anbn) 


and with this definition the n-tuples form a linear algebra. This 
type of multiplication is occasionally useful. Another type of mul- 
tiplication of n-tuples leading to a linear algebra is described in 
Chapter 6 and plays a more important role in coding theory. 

The identity element of the vector space will be denoted 0 , 
the same symbol as is used for the zero element of the field. (The 
context will make clear whether the symbol 0 means a vector or 
a scalar.) In the set of all n-tuples, 


O0=(0,..., 0) 


It is clearly true for n-tuples and in fact easily shown for vector 
spaces in general that for any vector Ov=0 , and for any 
scalar c,c0=0. Also, (-v) = (-l)v , for v+(-l)v = 
lv + (-1)v = [1 + (-1)]v = Ov =0 

A subset of a vector space is called a subspace if it satisfies the 
axioms for a vector space. In order to check whether a subset of 
a vector space is a subspace, it is necessary only to check for 
closure under addition and multiplication by scalars. Note that, 
since -v =(-l)v , closure under multiplication by scalars assures 
that the inverse of each element is in the subspace. Then closure 
under addition is sufficient to ensure that it is a subgroup, and the 
associative and distributive laws must hold in the subspace if they 
hold in the original vector space. 

A linear combination of n vectors Vi »--+s Vy is a sum of 
the form 


uSarv; +azgv2 +... + AanVvn 


The a; are scalars, that is, field elements, 





introduction to algebra 21 


Theorem 2.5. The set of all linear combinations of a set of 
vectors vy ,..., Vy of a vector space V is a subspace of V. 


Proof: Clearly every linear combination of vectors of V is also a 
vector of V. If the set of all linear combinations of v, ,..., v, is 
called S , and w=biv; +... + bhvn andu=cyy, +... +Chvpy are any 
two elements of S , then wt+u isalsoin S, for wtu=(b, +c, )v, + 





. + (by + Cyp)vqp is in S . Also any scalar multiple of w , 
aw =abjv; +...+ ab,vyn isin S . Since S is closed under addi- 
tion and multiplication by scalars, S is a subspace of V 
QED 
A set of vectors v, ,..., vy, is linearly dependent if and only if 
there are scalars c, ,..., C, not all zero such that 
Cr Vit Co V2 Cte et Cavan. = 0 


A set of vectors is linearly independent if it is not linearly depend- 
ent. A set of vectors is said to span a vector space if every vector 
in the vector space equals a linear combination of the vectors in the 





set. 
Theorem 2.6. If a set of n vectors Vi s+++s Vy Spans a 
vector space that contains a set of m_ linearly independent 
VOCtOtS” Gy js cy ch then n2m 

Proof: Since v, ,..., Vy, spanthe space, wu, can be expressed 

as a linear combination of the v; . Therefore this equation can 

be solved for some one of the v. , say VE > in terms of u, and 

the rest of the vj . Consequently the set consisting of u,; and the 


rest of the vj spans the vector space, since any linear combina- 
tion of the v; becomes a linear combination of u, andallthe vj 
except v, when the expression for v, in terms of u, and the 
other v; is used to eliminate v, . Then uz, can be expressed as 

a linear combination of u, andall the v; except Vv, + Since the 
uu; are linearly independent, some vj must have a nonzero coef- 
ficient, and therefore this v; can be expressed in terms of wy , u2 , 
and the remaining n - 2 v;» and these n vectors span the space. 
The process can be continued until all m of the u; vectors are 
used, and, since at each stage one v; vector is replaced, the num- 
ber of vectors v; must have been at least as great as the number 
of vectors u; 


QED 


Theorem 2,7, If two sets of linearly independent vectors span 
the same space, there are the same number of vectors in each 


set, 
Proof: If there are m vectors in one set and n in the other, 
then by Theorem 2,6 m&n and n&m , andthuea men, 


QED 
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In any space, the number of linearly independent vectors that 
span the space is called the dimension of the space. A set of n 
linearly independent vectors spanning an n-dimensional vector 
space is called a basis of the space. It follows from Theorem 2.7 
that every set of more than n vectors in an n-dimensional vector 
space is linearly dependent. It follows from Theorem 2. 6 that no 
set of fewer than n vectors can span an n-dimensional space. 


Theorem 2.8. If V is an n-dimensional vector space, any 
set of n linearly independent vectors in V isa basis for V. 


Proof: Let v; , vz,.--, Vn bea set of linearly independent 
vectors in V . If they do not span V , there must be some vector 
v in V thatis not a linear combination of v; , v2 ,...;5 Vi 
nen the set vi, Vin Vzi5..2<5. Vn Of +) vectors in GV: is: 


linearly independent. This contradicts Theorem 2.6, and therefore 
Vil e201 eee Vy USE Span Vv 
QED 


Theorem 2.9. If a vector space V, is contained in a vector 
space V2 and they have the same dimension n , they are 
equal, 


Proof: A basis for V, is a set of n linearly independent 
vectors in V, . Therefore every vector in Vz is alsoin Vj, 
QED 


An inner product or dot product of two n-tuples is a scalar and 
is defined as follows: 


(ajest« aty) ty (bitnteee Passe ar bitcsitae yb, 


It is easily verified that u-: v=v-+u andthat w- (u+v) = 
w.ut+w.v . If the inner product of two vectors is zero, they 
are said to be orthogonal. 


2.6. Matrices 


The purpose of this section is to outline the parts of matrix 
theory that apply to the codes studied in the next three chapters. 
For the most part, proofs are given, but this can hardly serve 
as more than a review of the necessary parts of matrix theory. 

An nXm matrix is an ordered set of nm elements ina 
rectangular array of n rows and m columns: 


ai aj2 ch DEA aym 


a21 a22 ei eun azm 


Mn. Ane...) @&nm 
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The elements of a matrix may in general be elements of any ring, 
but in this book only matrices with elements in a field find appli- 
cation. The n rows may be thought of as n m-tuples or vectors, 
and similarly, the m columns may be thought of as vectors. 

The set of elements a;; for which the column number and row 
number are equal is called the main diagonal. 


The row space of an nXm matrix M is the set of all linear com- 


binations of row vectors of M . They form a subspace of the vec- 
tor space of m-tuples. The dimension of the row space is called 
the row rank. Similarly, the set of all linear combinations of 
column vectors of the matrix forms the column space, whose 
dimension is called the column rank. 

There is a set of elementary row operations defined for matrices: 


1. Interchange of any two rows. 
2. Multiplication of any row by a nonzero field element. 
3. Addition of any multiple of one row to another. 


The inverse of each elementary row operation is clearly an ele- 
mentary row operation of the same kind. 


Theorem 2.10. If one matrix is obtained from another by a 
succession of elementary operations, both matrices have the 
same row space. 


Proof: If the theorem is true for each elementary row operation, 
it will clearly be true for a succession. It is obviously true of 
row operations 1 and 2. Suppose that the matrix M!' is obtained 
from the matrix M by type 3 elementary row operation. Then, 
since the altered row of M!' is a linear combination of two rows 
of M , any linear combination of rows of M' is also a linear 
combination of rows of M , so the row space of M' is contained 
in the row space of M . But M canbe obtained from M!' by the 
inverse operation, which is again an operation of type 3, so the 
row space of M must be contained in the row space of M". 


Therefore they are equal. 
QED 


Elementary row operations can be used to simplify a matrix 
and put it in a standard form. The form, called echelon canonical 
form, is as follows: 


1, Every leading term of a nonzero row is 1. 

2. Every column containing such a leading term has all its 
other entries zero, 

3. The leading term of any row is to the right of the leading 
term in every preceding row. All zero rows are below all 
nonzero rows, 


The procedure is essentially the same as that used in solving 
linear equations by elimination of one variable at a time, It is 
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best illustrated by an example. Consider the following matrix 
with real numbers as elements: 


Ow Os V2. wae iO 2) 


z: @Z Oy SG) oe. 38 
le* lee Se 6m) 2h 5 
pA Cake a Sol Se 


To simplify the matrix, the first step would be to locate the first 
column with a nonzero element, interchange rows if necessary to 
place a nonzero element in the first row, and multiply the er 

the inverse of that element to give a leading 1. Interchangin 
rows I and 2 and dividing by 2 give iii 


Wp Peles? heed 


OUOt 2) te. 404 ee 
ele ote 2a 
A ligt gS ahs” AD ae 


The next step is to subtract a multiple of the first row from each 
othes row to make the rest of the column corresponding to the 
leading element in the first row 0: 


he dis oS eS O12 A 
DAD a ae eae 
Ob ONS Zena: a 
Or OL OF EO = 3 


Then, with disregard of the first row, again the first column with 
a nonzero element is located, and rows are interchanged if nec- 
essary to place a nonzero element in this column in the second 
row. The row is next multiplied by the inverse of its leading-ale: 
incendien give a leading 1 . This is accomplished in the above 
matrix by dividing the second row by 2. Then the appropriate 
multiple of this row is subtracted from each other row to robs all 
the other entries 0 in the column of the leading element of the _ 
second row. This yields : 


Cent RS eI | 
0) ae 0) 
CR 0 Yeas 3) 
0) Ory Oca Sa 


ee = 


One more step in the process yields 
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1, ole (0: asl ph Aad 
OM Ore aie +0 
Ong 0 2 Ome Oe Ore rk 
Om 0. 0-0) 70 


This process will always result in a matrix in echelon canonical 
form. 

The nonzero rows of a matrix in echelon canonical form are 
linearly independent, and thus the number of nonzero rows is the 
dimension of the row space. It can be shown that there is only one 
matrix in echelon canonical form for any given row space. 

If all the rows of an n Xn matrix are linearly independent, the 
matrix is said to be nonsingular. When such a matrix is put in 
echelon canonical form, there must still be n linearly independent 
rows, and thus every row must contain a 1. This can occur only 
if it has 1's on the main diagonal and 0's elsewhere. Sucha 
matrix is called an identity matrix and denoted I . Thus any non- 
singular matrix can be transformed into an identity matrix by ele- 
mentary row operations. 

The transpose of an n Xm matrix M is an mXn matrix, 
denoted M- , whose rows are the columns of M , and thus whose 
columns are the rows of M . The transpose of [a;;] is [aji] : 

Two nXm matrices can be added, element by element: 

[a5] + [b, 5] = [as + bi] 
With this definition it is easily verified that matrices form an 
Abelian group under addition. 

An nXk matrix [aij] anda kXm matrix [b;,] can be mul- 

tiplied to give an nXm_ product matrix [ci] by the rule 


k 


os; = > oY had Fr 
g=1 


It can be verified by direct calculation that with this definition 
matrix multiplication satisfies the associative law, and multiplica- 
tion and addition satisfy the distributive law. 

The element c;; of the product is the inner product of the 
row of [aj;] by the j= column of [b;j] . Also the i row 
vector of the product [cj;] is a linear combination of the row 
vectors of [bo ;] with the coefficient ajg on the oth row. Simi- 
larly the columns of the product are linear combinations of the 


jth 


column vectors of lay | F 
Multiplying an n*m matrix M on the left by a matrix P that 


has one 1 in each row and each column and all the rest of the ele- 
ments 0 simply permutes the rows of the matrix M , and any 


rai 


F i a 
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i al to every vector of a 
permutation of rows can be accomplished in this way. Thus the Theorem 2. 14. Ifa eater ae irri space of V; 
first elementary row Operation can be accomplished by multiplying set which spans V, , it is in 
on the left by a permutation matrix, The second elementary row Proof: If v; ,...,V, span V; , then every vector in V; can 
Operation, multiplying the jth row of M by c , can be accom- be Buneanwad in the form v =c, vy) +..-+ CnVp_- Then 
plished by multiplying M _ on the left by a matrix that has 0's off 
the main diagonal, c on the main diagonal in the j row and l's ve us(cqyv, t...¢ CpVp) UE CV) - Ut...+CpYn: U 


on the rest of the main diagonal. Finally, the third elementary 
Operation, adding c times the j*® rowto the kth row, can be 
accomplished by multiplying on the left by a matrix a has 1's 
on the main dia onal, c in the position that is in the j column rer 

and kth row, as O's ebwabiitan These matrices in called The null space of the row Reare s Peppa e ax Sepen es fact it 
elementary matrices, space of the matrix. A vector is in the null aha Paige hit 
ee Denes aes e is orthogonal to each row of the aRSE i 309 Oe fan mxXn 
sidered to bea 1Xn seaniaebe v is in the null space o 


i tee lto v 
and if u is orthogonal to each vj , it is orthogona hee 


Theorem 2.11, Every nonsingular matrix has a left inverse 


that is a product of elementary matrices. matrix M if and only if vM 0 
Proof: If a nonsingular nn matrix M is transformed into Theorem 2.15. If the dimension of a subspace of n-tuples is 
echelon canonical form, it becomes an identity matrix. Since M k , the dimension of the null space is n - k 
can be put in echelon canonical form by elementary row operations, : ; ; i it requires some 
there is some set of elementary matrices oe Asie} E,, whose The proof of vahag ake ap Sanath geen es yt a the theorem 
product with M is the identity matrix. backgruune ‘Gmyr wise wEnwrenee sy ri 
is 
ee he eee Theorem 2.16. If Vz is a subspace of n-tuples par is 
————— 7 ace Oo 
Then E,... E, is the left inverse of M . Se th aes ash inoe iene F i k 
GED Proof: If Vz has dimension k , then V, has ean es 
— : . . Since 1s con 
Theorem 2.12. If M isan nXm matrix and S is a non- and the null space of V, has gi ob sbidd rote aha are equal, 
singular nXn matrix, then the product of S and M has the in the null space of V, and has the QED 
Same row space as M has. d 
i that have n columns, an 
Proof: The rows of SM are linear combinations of the rows of If M, and Mz pags aes ROT AS the row space of M2 is 
M , and therefore the row space of SM is contained in the row if M;M2z~ is a matrix of al mas “i @ibe veveu dete row 
Space of M . But S has a left inverse S7! , and the rows of contained in the null space of = M ack to n , then the row space 
S-'SM=M are linear combinations of the rows of SM , and hence rank of M, and the row rank o oe ioe eee, 
the row space of M is contained in the row space of SM . There- of Mz is the null space of M, , an Mit Bone rnieNo ania tse 
fore, they must be equal, There are many important concepts and theo eget AN 
QED * theory that have not been mentioned. For example, e 


and column rank of a matrix can be proved equal, and a left inverse 
is also a right inverse. Determinants are of some use in later : 
Again it should be emphasized that, while the materia 


Theorem 2.13. The set of all n-tuples orthogonal to a Subspace 
V, of n-tuples forms a subspace V2 of n-tuples. This sub- 


Space V2 is called the null space of V, pe bys here may be adequate for understanding cadeieah ona 
Proof: Let V,; bea subspace of the vector space of all n-tuples it is certainly no substitute for cour De alecdincs of the subject. 
over afield. Let Vz be the set of all vectors orthogonal to every bra, which can provide a well-rounde 
vector in V,; . Let’ v be any vector in V,; and uw, and ug any 
vectors in V2 . Then We ev ORO: FCA wise ye) a! oe 
O=v.- (u; +uz). Therefore Ui, +O, dette Ve bo Adiga « (cu,) = 
c(v'. uy) = 0), “80 cu; isin Vz, , Thus V,; must be a subspace, 


QED 
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NOTES 


There are many good textbooks on algebra and on matrices. Birkhoff and 
Mac Lane” covers all the material of this chapter and much more. It is clear- 
ly written and is probably the most easily understood text on modern algebra. 
It also contains an extensive bibliography. Van der Waerden!!? ig also well 
written and highly regarded, and goes generally deeper into the subject. 


PROBLEMS 


2.1. Show that there is only one group of three elements. Show that there 
are only two distinct groups with four elements, and that both are Abelian. 


2.2. Show that if the operation is taken as addition in the groups of Prob- 
lem 2. 1,multiplication can be defined to make them rings. 


2.3. The set of all nonnegative integers is nota group with the operation 
addition. Why? It is also nota group with the operation multiplication, Why? 


2.4, The set of all nXn matrices is not a skew field. Why? The set of 
all nonsingular n Xn matrices is also not a skew field. Why? 


2.5. Show that the operation subtraction does not satisfy the associative 
law. 


2.6. Solve these simultaneous equations for x and y , assuming the 
field of 4 elements as given in Table 2.3: 
axty=b 
x tay =b 
(Answer: x =y = 1.) 


2.7. Calculate the determinant of the following matrix, Put the matrix 
in echelon canonical form and show that the rank is 3, Express the inverse 
as a product of elementary matrices. Assume the field of three elements. 


ree ee 
ay 2 oh 
dey Tes i 


2.8. By row operations, find the echelon canonical form for the following 
matrix, Also calculate the determinant. Assume the field with two ele- 
ments. 


Fe 1 Gaet 
Me OLAR os 
On Deut s5 
oS ey 





29 
introduction to algebra 


2.9. Show that in the vector space of n-tuples over the field of Metdhaste 
sneaks every subgroup (under addition) is a subspace. (Compare Prob- 


lem 6.8.) . 
2.10. Define the Hamming weight w(v) of ann-tuple v as its Hamming 
distance from the zero n-tuple. Show that 
d(u, v) = w(u - v) 
2.11. Let H bea subspace of n-tuples, and define the Hamming sees 
of * coset of H as the minimum Hamming weight of elements of the coset. 


Define the distance between two cosets as the weight of the difference o 
the two cosets, which is also acoset. Show that this distance function is 


a metric. (Compare Problem l. 2.) 


2.12. If an nXn matrix has the form 


I. P 


(@) I 


F< 


n-k 


where I, isa kXk identity matrix, Le wsian (n ~ k) x (n - k) identity 
matrix, O is an n-kXk matrix of all 0's , and P isan risa : 
kxXn st matrix, show that the inverse of M has the same form wit 


replaced by -P. | 
2.13. Prove that the set of all n Xn square matrices that have “ s on 
the main diagonal and 0's below the main diagonal forms a group under 


multiplication. 


Chapter 3 


LINEAR CODES 


3.1, Definition of a Linear Code 
a Oe ON 


Consider a channel for which the number of symbols q isa 
power of a prime number and therefore for which the symbols can 
be the elements of a finite field, The case of q=2 gives the 
binary channel with the Symbols 0 and 1. The set of all n-tuples 
of field elements is a vector Space. A set of such vectors is called 
a linear code if and only if it is a subspace of the space of all n- 
tuples. In the binary case, and in fact over a field of p elements, 
where p is a prime, every group of vectors is also a linear space, 
(Problems 2.9 and 6.8.) The term group code or group alphabet 
is the common terminology for binary linear codes .!05 

The Hamming weight of a vector v , denoted w(v) , is defined 
to be the number of nonzero components. Since the Hamming dis- 
tance between two vectors v,; and v2 is the number of positions 
in which they differ, the distance between v, and v2 is equal to 
wiv, - v2) . If v, and v2 are both code vectors of a linear code, 
then v, - vz must also be a code vector, since the set of all code 
vectors is a vector space. Therefore the distance between any two 
code vectors equals the weight of some third code vector, and the 
minimum distance for a linear code equals the minimum weight of 
its nonzero vectors. This property is extremely helpful in analyzing 
error-correction capabilities of linear codes, 





Example: For values of q=2 and n=5 , the set of vectors 
(OLO" OCOV OI Al 0:00 1), (ONTO, 1:0) eae teOL Oat) (O10 I Oen)u. 
OMT Os (On Tol ted) and (11100) form a vector space 
V; and hence a linear, or binary group code. The minimum 
weight is 2, and hence the minimum distance is 2. This code 
will be used as an example throughout this chapter. 


3.2. Description of Linear Codes by Matrices 


Any set of basis vectors for a linear code V can be considered 
as rows of a matrix G , called the generator matrix of V . The 
row space of G is the linear code V » and a vector is a code 
vector if and only if it is a linear combination of the rows of G 
If the dimension of the vector space V is k , the number of rows 
of G (which equals the rank of G » Since the rows must be 
linearly independent) is k , If any two linear combinations were 


40 
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equal, there would be a dependence relation among rows of G 
Thus each distinct linear combination gives a distinct code vector, 
and, since there are k coefficients with q possible values for 
each, there are qk code vectors in V Such a code is called 
an (n, k) code. 

The advantage of the matrix description should be clear: 
both q and k are small, the matrix description is much more 
compact than a list of code vectors. A (50, 30) binary roy code 
is described by a 30 X 50 matrix but has more than 10’ code 


Unless 


vectors, 
Example: The code V, in the preceding example is the row 
space of either of the following matrices: 

ee Or deel 1? GF 0G, eran 

diet Os 1 A Os ae 

ORT Ot cry (Or oe pt eu 


There is an alternative description by matrices. Againif V as 
a subspace of dimension k , its null space is a vector space Vv 
A matrix H of rank n-k whose row 

as rows. Then V 


if and only if 


of dimension n-k 
space is V' can be made with a basis for V 


is the null space of V' , andavector v is itt Ni } 
it is orthogonal to every row of H , thatis, if and only if 


eins oti (3. 1) 


If Vv Bia) 5 a2) o, eats ; an) and the element in the a row and 
jth column of H is denoted h;;, then Equation 3.1 implies that 
for each i (that is, each row of H) 

Za.h.. = 0 (3. 2) 
j IN 
Thus the meaning of Equation 3.1 is that the components of v must 
satisfy a set of n-k independent equations. Of course, any 
linear combination of the Equations 3.2 also gives an equation that 
the components of v must satisfy, and this corresponds to the fact 
that v is orthogonal to every vector of V'. These equations are 
called generalized parity checks, since 5 the binary case hey are 
simply of checks for even parity on certain sets of waged in the 
code word, That is, for each row of H , the number of 1 . Vs 
that correspond to 1's in that row of H is even, for the binary 
case, if and only if v satisfies Equations 3.2. Thematrix H is 


calleda parity-check matrix of V 


Example; The null space V, of the vector space V, of previous 
examples consists of the four vectora (00000), (1101 OO); 


(10101), and(0 1111), These four vectors forma vector space. 
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The first two nonzero vectors are linearly independent and are 
abasis. Thus V, is the row space of the matrix 


I 6 3, 6 

OSS laser ed) 

The code V, is the null space of this matrix. To each vector 
in V2 there is an equation that the components of every code 


vector must satisfy. For example, corresponding to (01 1 1 1) 
is the equation 


Oa; + laz + la; + lag + la, =0 


that must be satisfied by every code point (a, , a2 , a, (ag rae ) 
For binary codes, this is equivalent to having an even a AD of , 
1's among the last four components or an even parity check on 

the last four components. Note that, unlike vectors over the field 
of real numbers, a vector over a finite field can be orthogonal to 
itself. For example, (0111 1) is in both V, and V2 


Both a vector space V and its null space V' are subspaces of 
the space of all n-tuples, and therefore both of them are linear 
codes, They are called dual codes. If V is an (n, k) code, V' 
is an (n, n-k) code. If a code is the row space of a matrix, its 
dual is the null space, and vice versa. ; 


Theorem 3.1. Let V bea linear code, which is the null Space 
of a matrix H . Then for each code word of weight w , 
there is a linear dependence relation among w columns of H, 
and conversely, for each linear dependence relation involving 
w columns of H , there is a code word of weight w 


Epnoor: Ai Vector "vi =i(ay page a,) is a code word if and 
only if 
es =0 
or, if the ith 1 i i i 
f i column vector in the matrix H is denoted h; 5 
n 
y a.h. = 0 
a OF 
i=] 


This is exactly a linear dependence relation among columns of H 
and the number of columns of H that appear with nonzero coef- 
ficients is the number of nonzero components a; of v_ , whichis 
exactly the weight of v . Similarly, the coefficients of any de- 
pendence relation among columns of H are components of a vector 
that must be in the null space of H 


QED 
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Corollary 3.2. A code that is the null space of a matrix H has 
minimum weight (and hence minimum distance) at least w if 
and only if every combination of w- 1 or fewer columns of H 
is linearly independent. 


Note the distinction between this condition and the definition of 
rank of a matrix. For a matrix to have column rank r or greater, 
there must be at least one set of r columns that is linearly inde- 
pendent. 

For the purpose of studying error-correcting properties for any 
channel with independent errors, two codes that differ only in the 
arrangement of symbols have the same probability of error. In 
general, two such codes are very closely related, and are there- 
fore called equivalent. More precisely, if V is the row space of 
a matrix G , then V' is a code equivalent to V if and only if V' 
is the row space of a matrix G' , which is obtained from G by 
rearranging columns. Thus permuting the columns of a generator 
matrix leads to a generator matrix for an equivalent code. Any 
elementary row operation on a matrix results in a matrix with the 
same row space, and therefore the altered matrix is a generator 
matrix for the same code. If one matrix can be obtained from 
another by a combination of row operations and column permuta- 
tions, the two matrices are called combinatorially equivalent. 

Every generator matrix G is combinatorially equivalent to one 
G' in echelon canonical form. In fact, since G' can be obtained 
from G by row operations, they generate the same code. Then 
by column permutations, the k columns that contain the leading 
1's of each row can be arranged at the left in the form ofa k Xk 
identity matrix, resulting in a combinatorially equivalent matrix 
G" of the following form: 


OLY ee Oe py Rs oe PT, one 
0 1 Se oe 0 P21 Pee ae Pz ,n-k 

Fen Oe : ‘ . 5 re 

Gia} ay . = [1,P] (3.3) 
FM 4 a Pic tae, Pie on oc 


This is called reduced-echelon form. (The terminology is not 

uniform on this subject.) Thus there is a reduced-echelon matrix 
G'' combinatorially equivalent to every generator matrix G , and 
every code is equivalent to the row space of some matrix in reduced- 


echelon form, 


Now let v = (a, , a ,.++,) @) arbitrary k-tuple, and consider 
the vector H that is the linear combination of rows of G'' with 
a; as the i coefficient: 
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u = vGi"s"(aiy {ese Mes Cy 


where 


k 
¢; = zi 2,P i; (355) 


Thus the first k components of the code vector can be arbitrarily 


chosen information symbols, and each of the last n - k components 


is a linear combination of the first k components. Encoding is 
thereby greatly simplified. A code of this type is called a system- 
atic code; the first k components are called information symbols 
and the last n - k components are called redundancy or check ' 
symbols. Thus the following theorem holds: 


sheorem 3.3. Every linear code is equivalent to a systematic 
code. 


There is a simple way to finda parity-check matrix for a code if 
a generator matrix in reduced-echelon form is given: 


Theorem 3.4. If V_ is the row space of the matrix G =[I P] 
where I, isa kXk identity matrix and P isa kx (n BY 
matrix, then V is the null space of H = [-PTI ], where 
by te an tn = bY TAs Widen eae” OSS 


Proof: It can be easily verified that GH! =0 , and, since the 


cg of their ranks is n , the row space of G is the null space of 


QED 
Gig OSA EP a are Ay» C1 » C2 ,-.+, Cy_y) is a code vector, 


then 
r 
GH 320 = = 
aiP ij + e 


which is exactly the same as Equation 3.5. The connection between- 


G and H in this form can be seen clearly ad noting that in either 
case Pj; » the element in the iD row and jth column of P , is 
just exactly the coefficient of the ith information symbol a. in 
the sum that gives the jth parity-check symbol cj , 
Example: The generator matrix 
LO, CO 
G=j0 1 0 1 O} = [I,P) 


0: Oy Te Oe ot 


for the code used in previous examples ia in reduced-echelon form, 
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If t fae oO 


se oe ters) 
MOG as poate amigal 


then cu! = HG? = 0 , and the row space of each is the null 


space of the other. In this form, the first three components of 
each code word (a; az a; a4,a,) can be chosen arbitrarily. The 
other two are parity-check symbols 


a, = ay, + a2 


a, =a, + a3 


as can be seen from either matrix. In G , the fourth column 
has 1's in the first and second rows,and therefore the first and 
second information symbols are involved in the parity-check- 
symbol calculation for the fourth symbol. In H , since each 
row is in the null space of the code, every code word is orthog- 
onalto each row of H . In particular, for the first row of H, 


la; + laz + 0a; + lag + Oa; =0 
and this equation can be solved for a, 
3.3. The Standard Array 


Let V bean (n, k) linear code, hy be the identity element, 
and hz , hj,..-, hk the other code vectors. Thena decoding 
table can be formed as follows. The code vectors are placed in 
a row with the identity element at the left. Next, of all the re- 
maining n-tuples, one, say g; , is placed under the identity ele- 
ment. (This would ordinarily be one of the most likely to be re- 
ceived if the identity vector is transmitted.) Then the row is com- 
pleted by placing under each code vector h;, the vector g, + hj 
Similarly a second vector gz is placed in the first column and the 
row similarly completed. The process is continued until each 
possible n-tuple appears somewhere in the array. This standard 
array is, of course, exactly the array of cosets described in 
Chapter 2. The rows are cosets, and the vectors in the first 
column are coset leaders. 

Ifa vector u ‘is transmitted anda vector v is received, then 
v -u is called the error pattern. 


Theorem 3.5. If the standard array is used as a decoding 
table, then a received vector v will be decoded correctly 
into the transmitted vector u if and only if the error pattern 
v-u is a coset leader, 


Proof: If v-u#g,, the coset leader of the th coset, then 


veg, tu must appear in the standard array in the ith coset 
under the code vector u and will be decoded correctly. If, on 
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the other hand, v - u is not a coset leader, v must still be in 
some coset, say the jth » with coset leader g- . Then v isin 
the jth row but not under u , for v # 8; ria" 

QED 


Suppose that the linear code is the null space of an rXn matrix 
H , whose rows may, but need not, be linearly independent. For 
any received vector v , the r component vector 


s =vHT 
is called the syndrome* . Since the code is the null space of H , 


a vector is a code word if and only if its syndrome is zero. In 
general, each row of H corresponds to a parity-check equation 
that code words must satisfy. The components of S are zero for 
all equations that are satisfied, and otherwise are nonzero. 


Theorem 3.6. Two vectors v, and v2 are in the same co- 
set if and only if their syndromes are equal. 


Proof: It was shown in Chapter 2 that two group elements Vv} 
and v2 are in the same coset if and only if (-vz) +v; =v, - v2 
is an element of the subgroup, which in this case is the code 
vector space. If the code space is the null space of H , then 
vi - v2 is in the code space if and only if 


(vy = de =0 
Since the distributive law holds for multiplication of matrices, 


(vy, - v:)H- avy" - v,H? =0 
so that v, - vz is a code vector if and only if the syndromes of 
v; and v2 are equal. 
QED 


The decoding process can now be greatly simplified over the use 
of a decoding table. A table is formed that shows the coset leader 
and the syndrome for each of the 29-K cosets. When a vector is 
received, the syndrome is calculated. Then the coset leader is 
looked up in the table. This is the presumed error pattern, and 
subtracting it from the received vector gives a code vector that 
is assumed to have been sent. While in many cases such a pro- 
cedure reduces memory requirements for the table by a large 
factor, the table may still be very large. For example, fora 
binary (100, 80) code the decoding table would require 2 entries, 
which is a number beyond consideration. The number of cosets is 
2°, a much smaller value but still impractical. 


*This is Hagelbarger's terminology.”® The terma "parity check 
vector" and "corrector'® have also been used, 
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Theorem 3.7. Let V bean (n, k) linear binary code (that is, 
a group code) to be used with the binary symmetric channel, 
and assume that the code vectors are equally likely to be trans- 
mitted. Then the average probability of correct decoding is as 
large as possible for this code if the standard array, with each 
coset leader chosen to have minimum weight in its coset, is 
used as the decoding table. 


Proof: Denote by Vis the vector in the jth row and hoe column 


of the decoding table. ‘The code words placed at the top of the column 
are denoted Yoj - Denote by d;; the Hamming distance between a 
received Wa and the code word into which it is decoded, V oj 

Then the probability of correct decoding if the code word Voj is 
transmitted is 


2n-k_ 


1=0 


where FP is the channel eheneomae of error and Q=1-P 
(See Fig. 1.4.) Since there are 2“ code words which are as- 
sumed equally probable, in averaging the probability of correct 
decoding, the weighting factor 2™* is used: 


d,. n-d., 
FWicorrect decoding) = o% p: : eat Weg 
i, j 
There is one term in the sum for each possible received vector 
of binary symbols, and that term is maximized in each case if that 
particular vector is decoded into the closest code vector in the 
Hamming sense, since P-+J Q™~°ij is a monotone decreasing func- 
tion of dj; . Therefore the probability of correct decoding will 
be maximized if each received vector is decoded into the closest 
code vector. 
Now suppose that a particular vector v appears in the decoding 
table under the code vector u, whichis at Hamming distance w. 


Suppose that the closest code vector u, is at distance w, . Let 
g denote the coset leader of the coset that contains v . Then 
g=v-u has weight w . The element v - u; =g+(u-u,) has 


weight w, and is in the same coset. Since it was assumed that 
g has minimum weight in its coset, w,;2 w , andtherefore v 


is at leastas close to u asto w 
QED 


The number of coset leaders of weight i is denoted a; . The 
probability of correct decoding can be written 
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P(correct decoding) = a,Qv +a, > iil + az P? Qe-® ae (3. 6) 
Example: A standard array for the code used in previous 


examples is 


0. 0:0:0:0)" WOOhN ay JON 021108 FL MNO OlI10'0 1.091 LOMO OV ie 8.1.00 
00001 10010 01011 11000 00100 HOLY SONA Oe Al 1 0 1 
00010 LOOOT “ONO: 1011 OO To al OPcOwO. Oi iO Tea 1-16 
10000 O@01 LVoTo 01001 EOWO DY (O.00O Wetter 01100 


In each case, the coset leader was chosen to be a remaining 
vector of smallest weight. Such a procedure leads to optimum 
decoding. (Note that this does not mean an optimum code. It 
might be, though it is not true in the present case, that a dif- 
ferent choice of code words would give smaller probability of 
error.) This code corrects three of the five possible single- 
error patterns. Note that (00001) and (0010 0) are in the 


same coset, since (00101), their difference, is a code vector. 


Therefore, these two error patterns cannot both be corrected. A 
similar result occurs whenever there is a code word of weight 
2; minimum weight 3 is necessary and sufficient for correcting 
all single errors. 

For the code, both parity checks are satisfied, For the next 
coset in the array, the syndrome is 0 1;for the next, 1 0; and 
for the last, 1 1. Note that in each coset there is a Vector with 


0's~ as the information symbols and the syndrome as check sym- 
bols. 


3.4. Step-By-Step Decoding 


Assume that for each received vector it is possible to determine 
the weight of the minimum weight element in its coset. This would 
be possible if a table showing the correspondence between syn- 
drome and coset leader were available. It is conceivable that this 
would be possible with much less memory than such a table would 
require, and in fact for a few codes discussed in Chapter 11 this is 
the case. Then decoding can be done in the following step-by-step 
manner. ‘ 

Number the field elements from 1 to q, making the zero ele- 
ment last, but in any manner otherwise. Now order the vectors 
lexicographically, that is, (b, ,..., ib,s)!' follows “(ais Se pee eat 
bj follows aj in the order of the field elements, and the 9% tosis 
tion is the first in which the two vectors differ. Define the weight 


of a coset to be the weight of the minimum weight element in the 
coset. 


Given a received vector Ri ee ences a,,) , first the weight of 
the coset is determined, Then a, is replaced successively by 
a, - f} , a, - fz , and go on, where f; is the ith field element 


in the defined order, The weight of the coset containing the re- 
ceived vector with the altered firat Component ia determined, 
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If the weight is smaller in any other case, a, is replaced by 
a, - fj , where f; is the first field element resulting in smaller 
weight. If smaller weight does not occur, a, is retained as the 
first component. Then the same procedure is applied to the second, 
third, and all components in succession until a vector results that 
is in a coset of weight 0, that is, in the code. This is the code 
vector assumed to have been transmitted. This procedure is called 
step-by-step decoding. It will be shown below that step-by-ste 
decoding decodes every received vector into the nearest code 
vector, and that the coset leaders in the decoding table have an 
interesting property. 

A vector v is called an immediate descendant of u if v can 
be obtained from u by changing one nonzero component to zero. 
A vector v is calleda descendant of u if there is a chain 
Up = U, W , UZ,-.-, U, EV such that, for each i, u; is an 
immediate descendant of uj_j 


Theorem 3.8. If v is a vector of minimum weight in its 
coset and u is a descendant of v , then u has minimum 
weight in its coset. 
Proof: It is sufficient to prove the theorem for immediate 
descendants, since the property is hereditary. Then v-e=f=u, 


where e has weight 1. Each element of {u} , the coset that 
contains u , is of the form stu=s+tv-e, where s isa 
code vector. Since s+v isin {v} , and since e has weight 1, 


each vector inthe {fu} differs in only one component from some 
vector in {v}. Therefore the weight of fu} could differ by no more 


than 1 from the weight of {v} . Since the weight of u is one 
less than that of v, u must have minimum weight in its coset. 
QED 


Theorem 3.9. If u is the minimum weight vector in its coset 
which precedes all other minimum weight vectors in its coset, 
and if v is a descendant of u , then v is the minimum 
weight element in its coset which precedes all other minimum 
weight vectors in its coset. 


Proof; Again it is sufficient to prove the theorem for immediate 


descendants. Assume that v-uz=e , whichis 0 except in the 
th position. Then each element of {v} differs from some ele- 
ment of {u} only by e . Consequently every element of minimum 


weight in {v} must be O in the kt position, since every element 
of minimum weight in {v} has more 0's than any element in{u} . 
Therefore every element of minimum weight in {v} must be the 
result of subtracting e from some minimum weight element of 

{u} . Consider the comparison of v with any other minimum 
weight element vy; in {v) . The element v is obtained by 
subtracting e from u , and vy, is obtained by subtracting e 
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from some other minimum weight element u; of {u} . The 
vectors u and u; must both have their kth components equal to 


the kth component of e . Therefore, since u precedes uy 
v precedes v, . 


2 


QED 


Theorem 3.10. (Slepian-Moore). If in each coset the minimum 
weight element that precedes all other minimum weight ele- 
ments is taken as coset leader, then every descendant of a 
coset leader is a coset leader. 


This theorem follows directly from Theorem 3. 9. 


Theorem 3.11. (Prange). Step-by-step decoding always re- 
sults in a code vector. The corresponding coset leader, that 
is, the difference between the received vector and the resulting 
code word, has minimum weight in its coset and precedes all 
other minimum weight elements in this coset. 


Proof: Let v be the received vector and g the minimum weight 
vector in the coset {v} which precedes all other minimum weight 
vectors in {v}. Let e; denote a vector that has a 1 inthe it 
component and 0's in all other components, and let 

g=fe, +...+fie, 


» 
1 w 


where w is the weight of g , where 
VE Oates Gee 


and where f, ,..., f,, are field elements. 

The first step in the proof is to note that the first component of 
v altered by the step-by-step decoding process would be the ij 
component, and it would have f, subtracted from it. Certainly if 
no earlier component is changed, and if no preceding field element 
is subtracted from the i, component, then f; would be subtracted 


from the i; component; for then, g'=g-f,e; , which has 
weight w- 1 , would be in the coset containing the altered vector, 
and hence the coset would have weight less than w . Suppose that 


éither an earlier component is changed or that the i, Component 
has a field element preceding f, subtracted from it. Suppose that 
the first change is f'e;, . Then the resulting coset must have 
weight at most w-1 , and hence a coset leader g' of weight at 
most w-1. Then g* + f'e; is a minimum weight element in 
{v} which precedes g , contrary to hypothesis. Therefore the 
first component of v altered in step-by-step decoding is the i 
component, andit has f, subtracted from it, 

Let v; denote the vector that results after j changes in v 
by the step-by-step decoding process, Next it will be shown by 
induction on j that the jth change in v , which ie i ete Te a 


1 
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is f.e;, . The proof for j = 1 is given in the preceding paragraph. 
Assume that it is true for j<&. Then the vector gg =fge;, + 
fay Cin} +... + fwej., is in the same coset as vp » for gg-vg= 
g-v, which is a code vector. Since gy is a descendant of g, 
it is a minimum weight element in its coset which precedes all 
other minimum weight elements in its coset, by Theorem 3.9. 
The argument in the preceding paragraph then shows that the next 
change which will result in the step-by-step decoding process is 
subtraction of fyej;, from vg to form v This is true whether 
the step-by-step decoding is started again from the first component 
or simply continued from the last change. 

Thus the step-by-step decoding process will make the w changes 
fei, preleias fwei,, successively in the received vector, and the re- 
sulting vector will be v - g , which is the desired code a caine FE 


3.5. Modular Representation of Linear Codes 


Let G bea generator matrix for an (n, k) linear code. Since 
the generator has k rows, and sincg’s column of all 0's would 
be ruled out as useless, there are q - 1 different types of columns 
possible. If rearrangement of columns is unimportant, a code oun 
be described by a list of the number of columns of each type. This 
is called the modular representation. 

Let M be a special kx (qk - 1) matrix that has as columns 
all possible vectors of k field elements except the vector of all 
O's . Then the jth column of M can be considered a ee 
of type j , anda code can be described by a vector of q* - 1 
positive integers 

Ne=(m , m25-.-,0 4 ) 
cae | 
in which n; is the number of columns of type i 
Note that the (qk - 1) Xn matrix 


K =-mM'cG (35 7) 


has as rows all possible nonzero linear combinations of rows of 
G and thus has all nonzero code vectors as rows. An important 
case is the matrix that is the entire code generated by M con- 

sidered as a generator matrix 


c=M™ (3. 8) 
It is clearly symmetric, and contains one column of each possible 


type. 
Now let us assume the binary case, 


Theorem 3,12, (MacDonald), A list of the weights of the 
2K - 1 nonzero code words of a binary group code can be 
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found as the components of the vector resulting from multi- 
plying as matrices of real numbers the modular representa- 
tion vector N by the matrix C: 


W=NC, or wl=cnt (3.9) 


(The weights of the code words appear in the same order as the 
code words appear in the matrix in Equation 3.7.) 


Proof: This can be seen by noting that the jth component of wt 
is obtained by multiplying the ith row of C by N_ . Since all the 
elements of C are 1's and 0's , this is just the sum of a certain 
subset of the components of N , those particular components re- 
ferring to columns that have 1's in the ith code word. 

QED 

The matrix C is nonsingular considered as a matrix of real 
numbers. The inverse can be found by changing the 0's in C to 
(-1) and dividing each element by 2k-1 The first step in 
proving this is to show that two different columns of C have 1's 
in common in 2K-2 rows, 

The rows of C together with a vector of all 0's forma group, 
since they are the row space of M . Consider the set of rows that 
have 0's inthe ith and jth columns. It is easily verified that 
they form a subgroup, There are four cosets, each with an equal 
number of elements — namely, the subgroup, the set containing 
every row with 0 in column i and 1 incolumn j , the set con- 
taining every row with 1 in column i and 0 in column j , and 
the set of rows with 1's in both columns. Thus one-fourth of the 
TOWER; OY 2" rows altogether, have I's in both column i and 
column j . It can similarly be shown that each column has 2*7! 
I's . (See Problem 3.3.) 

Since C is Le aieataeh if C is multiplied by itself, the diagonal 
elements are 25-1 | while all off-diagonal terms are 2k-2 


Crs tiles #1 + J) 


where I denotes the identity matrix and J denotes a matrix of 
all l's . It is easily verified that CJ = 2k-ly . Therefore, 


k-1 








2 2 
rw se Lag Be 5G sds Gee 
2a 2° a 
and so 
ct = ta (3. 10) 


2 


Thus if a list of weights, in the order in which the code words 
would appear in Equation 3,9, is given, the modular representation 
vector can be found and thus the code determined except for the 
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arrangement of columns. A given set of weights is poseinte it it 
can be arranged in a vector W in sucha way that N = WC” has 
components that are nonnegative integers. 

As a simple application of this principle, let us consider under 
what circumstances a code can have all its code words of equal 
weight wo Only one arrangement of the elements of W is 
possible. The product wWC-! then has every component equal to 
w, 27 F , Since each row of C7! has one more positive than 
negative terms. Since N = wc! must mk fe integral components, 
w. must be a multiple of 2k-1 ;, say t2>°"" . Thenevery: come 
ponent of vector N is t , and the code consists of t columns 
of each type. 


Example: For k=3 , M might be chosen as follows: 
O05 FON tae ly! dpe 


LOL Pee Yi? | 
Lye Org 


0 
Ne= 1°02 lL. 


0 
1a d0 She 0 


(The columns are in order as binary numbers.) Then 
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For the code used in previous examples 
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Neale DiaOsr ln ds elO} W=3(25.2).4,.3; 3; 3, 3) 


3.6, Linear Code Equivalence 
ee eh Ose /guivarence 


In studying properties of codes in which arrangement of columns 
isimmaterial, that is, properties common to equivalent codes, 
the modular representation is especially convenient. However, 
there are many possible choices of basis for the same code and, 
hence, many different generator matrices. In general they will 
result in different modular representation vectors, and it would be 
desirable to know when modular representations describe equiva- 
lent codes. 

There are two obvious necessary conditions. If two columns 
are identical in a code, they will be identical in any basis, and 
therefore if a column of type i occurs nj times in one repre- 
sentation, some other type of column occurs nj times in any 
other representation of the same or an equivalent code. Thus the 
components of the vector N are permuted but not otherwise 
changed. Similarly the components of the weight vector W are 
permuted but not otherwise changed. Now the problem is to char- 
acterize the permutations. 

Let S be any kXk nonsingular matrix. If v,; and vz are 
k-component vectors, v,S - v,S = (v: - v2)S is a linear com- 
bination of rows of S , and, since the rows of S are linearly in- 
dependent, v,;S-v2S is 0 only if v,; - vz is 0 . Therefore 
if v; and vz are unequal, so are viS and v2S . Then the 
q~ - 1 rows of Mts will all be different,where M is the matrix 
defined in Section 3.5. Since there are exactly qk - 1 different 
nonzero vectors, M*S must differ from MJ! only in having its 
rows permuted: 

M"S = P.M” (3. 11) 
where Pg is a permutation matrix, This matrix is called the 


A-permutation corresponding to S , (Note that Ps depends also 
on the choice of M ,) 
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There is for each i somewhere among the rows of M? , say 
in the kth row, a vector that has 0's in every position except 
the ith , anda 1 in that position. Then the it) row of S appears 
as the kth row of PoM? , and therefore different matrices S$ 
result in different permutations Pg . Furthermore, if S and U 
are nonsingular k Xk matrices, 


r 


mM su He Ss Miu =P.P,_M (Sule) 


iS) s'U 

that is, the product of SU corresponds to the permutation PgPy . 
It follows that the A-permutations form a group isomorphic to 
(that is, the same in structure as) the group of nonsingular k Xk 
matrices. 

Now consider the effect of an Ape Pees on the rows of 
the matrix C =M!IM . Let U=(S7!)* . Then 

By 2h T 


P =P M (Pp Me} 
Rigi Page gir ie eS U 


bared Tea fr 
= (M'S) (M U) =M SU M=M M=C 
F -1 
Since a permutation matrix is an orthogonal matrix, pl=p . 
and 
= (3. 13) 
PC CPy 

Therefore applying an A-permutation on the rows is equivalent 
to applying a different but related A-permutation to the columns 
of C 

Choosing a new basis and generator matrix for a group code cor- 
responds to multiplying the generator matrix on the left by some 
nonsingular matrix S . The nonzero code vectors for the genera- 
tor SG are the rows of 


M! (sc) = (M'S)G = (PM")G ‘ P,(MG) (3. 14) 


and these are the rows of M'G permuted by Pg . Thus choosing 
a new basis is equivalent to applying an A-permutation to the code 
words. The argument is clearly reversible. 

Also a column of type i in the matrix M!G which lists all the 
code words is identical to the it? column of the matrix C . Then 
in M!\(sG) = Pg(M‘G), this column is weil} like the i* column of 
PoC. But PgC = CPy, where U = (S"')” , and therefore the 
column of C which corresponds to the i’ columnof PgC is the 
column which Py permutes into the i” column, Therefore 


v4 ty (3; 15) 
N'sg "PsNG 
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where Nog and Ng are modular representations of the codes whose 


generator matrices are SG and S, respectively. Therefore two 


different generator matrices result in modular representations that 
differ by an A-permutation. The converse can similarly be shown. 


NOTES 


The first paper presenting a unified theory of linear codes was Slepian's 95,107 


and most of the material in Sections 3.1 to 3.3, as well as several of the 
problems, was adapted from his paper. Hamming*® and Golay‘® had pre- 
viously considered systematic codes. The description of a code as a null 
Space of a matrix was used by a number of people, and Theorem 3.1 and 
the corollary were apparently found independently by Sacks!°° and Dwork and 
Heller?® and earlier by Bose in connection with the design of statistical ex- 
periments, 

Theorem 3.10 was first suggested by Slepian and proved by Moore?!” in a 
slightly weaker form. The rest of Section 3. 4, including the present form 
of Theorem 3.10, consists of ideas and proofs of Prange, modified since 
Prange used Lee” distance rather than Hamming distance in his original 
presentation. 

Section 3,5 is adapted from MacDonald's work, 73:74 though equivalent re- 
lations between weights of code words and modular representations have 
been derived by Slepian,!°5 using the theory of group characters, and Bose 
and Kuebler,}? using a geometric argument. See also References 40 and 72. 
The last section is taken from Reference 41. (See also Reference 107.) 


PROBLEMS 


3.1. For the binary group code whose generator matrix is 
LWO Sok? 104 ly bd 
CORI te ere 
ORO Or aa 7 


a. Find the generator matrix G in reduced-echelon form for an equiva- 
lent code. 

b. Find the parity-check matrix H for the code in (a) . 

c. Find the code word that has 110 as information symbols. Show that 
it is in the row space of G and in the null space of H. 

d. Form the standard array for this code. Find the aj 


(Answer: aj) =1, a, =6, az =1.) 
e. Find the modular representation vector. 
(Answer: It consists of six 1's and one 0.) 
f. Find the weight vector. 
(Answer; One of weight 0, three of weight 4, four of weight 3,) 


3,2. Let H be the parity-check matrix for a linear code, Show that the 
coset whose syndrome is v contains a vector of weight w if and only if 
some linear combinations of w columna of H equala v . (Compare with 
Theorem 3, 1,) 
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3.3. Show that if all the vectors in an (n, k) linear code are arranged as 
rows of a matrix, each field element appears qk-1 times in each column. 
Assume that no column consists of all 0's. Hint: Show that the set of all 
code words with 0's in a particular component forms a subspace, and con- 
sider cosets.) 


3.4. Using the result of Problem 3.3., show that the sum of the weights 
of all code words in an (n, k) code is n(q - 1)qk-1 . Assume that no column 
consists of all 0's . 


3.5. Show that ina binary group code either all the code words have even 
weight or half have even weight, half odd. (Hint: Show that the code words 
of even weight form a subgroup. ) 


3.6. Show that if a binary group code has odd minimum weight, adding 
a parity-check digit that is a check on every digit in the code increases the 
minimum weight by 1. 


3.7. Show that if an (n, k) linear code with minimum weight w is used 
with an erasure channel and if w- 1 or fewer erasures occur, it is possi- 
ble to find a set of linearly independent equations that can be solved for the 
unknown symbols, Show that there is at least one case with w erasures that 
cannot be corrected. 


3.8. For the binary code used as an example in this chapter, decode the 
received vector v =(1011 1) by the step-by-step decoding process. 
Verify that the resulting vector u is a code vector, and that v-u is 
the minimum weight vector in its coset which precedes all other minimum 
weight vectors. 


3.9. Assume that it is known that a (13,5) code has a, = 1, a, = 1; 
az = 78, anda, = 152. Show that a, $2 andall other a; =0 for i>5 
(Hint: Use Theorem 3. 10.) 


3.10. Find the modular representation for a binary code with 
W = (3, 4, 3, 4, 3, 4, 3). Construct a generator matrix for the code. 
Assume the matrix M given as an example on page 43. 


3,11. Find the A-permutations corresponding to the elementary 3X 3 
matrices over the field of two elements. 





Chapter 4 


ERROR-CORRECTION CAPABILITIES OF LINEAR CODES 


In this chapter various upper and lower bounds are given for the 
probability of error or the classes of correctable errors for linear 
codes of a given size. The first two sections give upper and lower 
bounds, respectively, on the minimum distance for the code with 
the maximum minimum distance. Section 4.3 gives a different 
bound on the maximum minimum distance possible and a lower 
bound on probability of error for codes used with the binary sym- 
metric channel. Section 4.5 gives an upper bound on probability 
of error for the optimum binary group code used with the binary 
symmetric channel, The last section gives bounds on the number 
of parity-check symbols required for codes to correct or detect 
any single burst of specified length. These bounds serve asa guide 
for judging the efficiency of particular codes. 

A linear code that for some m has all patterns of weight m or 
less and no others as coset leaders is called a perfect code.* A 
code which for some m_ has all patterns of weight m or less, 
some of weight m+ 1 , and none of greater weight as coset lead- 
ers is called quasi-perfect. A binary group code is called optimum 
for the binary symmetric channel if its probability of error is as 
small as for any group code with the same total number of symbols 
and the same number of information symbols. 


4.1. The Plotkin Bound 


The sum of the weights of the code words of an (n, k) linear 
code with symbols taken from the field of q elements is 
ng*- (q- 1) . (See Problem 3.4.) The minimum weight ele- 
ment has at most average weight, and there are qk - 1 elements 
with nonzero weight. This gives an upper bound on the minimum 
weight: 


Theorem 4.1. The minimum weight of a code word in an (n, k) 
linear code is at most nqk-1 (q - 1)/(q¥ - 1) 


Now let B(n, d) be the maximum number of code words possible 
in a linear code of length n with minimum weight at least d 


*This is Prange's terminology, Golay used the term lossless, ''44 
and several others have used the term "close+packed, | 11% 
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Theorem 4,2. If n>d _, B(n, d) SqB(n - 1, dq) 


Proof: Let G bea code with n symbols, minimum weight d, 
which has B(n, d) code words. The set H of all code words whose 
last symbol is 0 forms a subspace of G , since the sum of any two 
elements of H is in H , and any scalar multiple of an element of 
H isin H . There will be q cosets of H in G , one for each 
symbol that may appear in the last position, and thus a fraction 1/q 
of the elements of G is in H . Then the subgroup H isa linear 
code of (1/q) B(n, d) symbols and minimum weight at least d, 
each of whose vectors has the last component 0. The last com- 
ponent can be dropped to give a linear code of n - 1 symbols with- 
out affecting the number of code words or the weight. There may 
be other columns of all zeros in the resulting code H , but these 
could be replaced by any other type of column without reducing the 
minimum weight. (Note that B(n- 1, n- 1)=q , the code con- 
sisting of n- 1 repetitions of a single information symbol. Thus 
with the assumption n>d _, nonzero columns are possible in the 
n - 1 symbol code.) Therefore, B(n - 1, d) 2 (1/q) B(n, 4d) 


QED 
Theorem 4.1 can be rearranged to give 
k k-1 
aq -1)Snq ‘(q - 1) 
qd (qd +n - nq) Sd 
and if 
qdt+tn-nqg>0O , 
d 
q” = Bin, dys = (4. 1) 


qdt+tn-nq 
Let(qd - 1)/(q - 1)=i+f,where i is aninteger and 0Sf< 1. 


ee ee ag pe AS 4,2 
Ey 0) See tqe pt: Teg dye se 
If n2i, repeated application of Theorem 4. 2 gives 


qd - 1 
n 


wy q-l d 
Bia, dJsq | BU, S44 (4. 3) 


ees 





It can be shown that qe = 1+(q- 1) f, and therefore 


n- 92-7 
B(n, 4d) 54 b qd (4. 4) 


Since B(n, d) = qk for the code with maximum minimum distance, 
where k is the number of information aymbola for that code, 
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This can be stated as follows: 


Theorem 4.3. If n2(qd- 1)/(q - 1) , the number of check 
symbols required to achieve minimum weight d in an n-symbol 
linear code is at least qd/(q - 1) - 1/(q- 1)-1- log, d 


If d is very large, the last three terms in this expression are 
negligible. This bound is plotted for the binary case in Figure 4. 1 
with these three terms neglected. 

The Plotkin bound can be proved for nonlinear codes also. 
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Figure 4.1, Bounds on minimum distance for the best code 
(the code length n is assumed to be very large) 
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4.2. The Varsharmov-Gilbert Bound 


By Theorem 3.1, if a matrix can be found for which no set of 
d- 1 or fewer columns is linearly dependent, the null space of 
the matrix is a linear code with minimum distance at least d 
This suggests the following method for constructing a code with r 
parity-check symbols and minimum weight d . Select any nonzero 
r-tuple as the first column of a parity-check matrix. Then select 
any nonzero r-tuple except multiples of this as a second column 
in the parity-check matrix. The third column may be any n-tuple 
that is not a linear combination of the first two. In general the jth 
column is chosen as any r-tuple that is not a linear combination 
of any d- 2 or fewer previous columns. This construction as- 
sures that no linear combination of d- 1 or fewer columns will 
ber0. 

As long as the set of all linear combinations of d- 2 or fewer 
columns does not include all r-tuples, another column can be 
added. In the worst possible case, all these linear combinations 
might be distinct. There are q - 1 possible nonzero coefficients, 
and thus there are 


()ia- 1) (3) ta- rae are 2) qe n> 


linear combinations of d-2 or fewer columns out of a total of j 
columns. If this is less than q* - 1 , the total number of nonzero 
r-tuples, then there is certainly one more column that can be added 
to the matrix. Thus, if 


- - - -2 
lene (q - 1) + ey (q-1)' +... ee (q - aoe eae 


(4. 5) 


there exists a code with n digits and at most r parity-check sym- 
bols (and therefore atleast k=n-r information symbols) with 
minimum distance d . The code is the null space of the rXn 
matrix that is formed from the chosen columns. 


Theorem 4.4. It is possible to construct a code of length n 
and minimum distance d with r parity-check symbols where 
r is the smallest integer satisfying Equation 4.5. 


For large n , asymptotic results can be obtained using the 
formulas of Appendix A, For example, using the Chernoff bound, 
Equation A. 8, with Equation A. 10 for the case q=2, 


d-2 n-1 1) 


Sti u ete 


ie] ien-1-(d-2) 


bye error-correcting codes 


and so there exists a binary (n, k) group code with minimum dis- 
tance d certainly if 


nH (<4) 
oheeke” 2 n-1 


Ze 


OF SE 


1-S2H@++-4) 
n 


nel 


But, since H(1 - x) = H(x) , 
1-*2H(S-4) (4. 6) 


This bound is plotted in Figure 4.1, for an assumption that d and 
n are sufficiently large that Hd - 2)/(n - 1)] = H(d/n) 


4.3. The Sphere-Packing Bound 
k 





An (n, k) linear code has q* code vectors and qh cosets. 


If a code is to correct all combinations of m or fewer errors, all 
vectors of weight m or less must be coset leaders. Thus the 
number of vectors of weight m or less must be no greater than 
the number of cosets: 


1+ (F)« = (3) «a A) eae (7) eRe: can halon 


Theorem 4.5. Any n symbol code with minimum weight 
2m +1 or greater must have at least 


tog, [2 +(T)ta- n+ (3): ea (7) (4- v| 


check symbols. 


This is usually called the Hamming bound, and it actually applies 
to nonlinear codes as well as to linear codes. 


Asymptotic formulas can be obtained again. Asa simple example, 


let q=2 and define 


Bi ,(n) =+ log : + (7) er (a) (4. 7) 


By Theorem 4.5, with m=)n, 


k < 
1 ay = B,,(n) ’ (4. 8) 


and with use of the results of Appendix A, it is easily shown that 


; m 
Biy s lim B(n) = H(\) = H(™) (4. 9) 





capabilities of codes 53 


This limiting value of the Hamming bound is plotted in Figure 4. 1. 

The argument can be modified slightly to give a lower bound on 
error probability for the binary symmetric channel. Assume for 
the moment that there exists a quasi-perfect (n, k) code, that is, 
a code for which, for some m , all vectors of weight m or less 
and no vectors of greater weight than m + 1 are coset leaders. 
The following argument shows that this code must be optimum: 
The probability of correct decoding can be written 


P(correct decoding) = a,Q” +i; por! + a2 P? grr pe 


where a; is the number of coset leaders of weight i . Since the 
quantities P’Q""* decrease as i increases (if P <Q), the proba- 
bility of correct decoding is increased whenever one aj is in- 
creased and another later in the sequence decreased. (Note that 
Og tide F Opt oon = a , the number of cosets.) For a quasi- 
perfect code, each of the first m coefficients a; is equal to the 
number of vectors of weight i , and so is as large as possible, 
The terms beyond the (m + 1)8t are 0, and A+] accounts for 
the rest of the cosets. Since no a; could be increased at the ex- 
pense of one later in the sequence,the probability of correct de- 
coding is as great as possible. Then the expression for probability 
of correct decoding is 


ws oe (") peel (2) es sath ee 
c 1 2 


‘ cae ts pmtign-m-1 (4. 10) 
m 
where m is the greatest integer such that 


m+l 
ses ()-(Qov Gee em 


Quasi-perfect (n, k) codes do not exist for all choices of n and 
k . In the cases where they do not exist, the best code has proba- 
bility of correct decoding which is less than P,, andthus P, is 
an upper bound on the probability of correct decoding for any 
(n, k) binary group code. 

A simple asymptotic result can be obtained as follows. It is 
convenient to work with a quantity E , called reliability. 


Es -lim 4 [ log, P(error for the best binary group code) ] 
n> 0 


and to define E, to be the sphere-packing bound on reliability: 
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n m+3_n-m-3 n 12) (Epes pest 
+ 3s)? Q neeey +(") P| -=(7 : P) (4. 12) 


where E(X, P) is the function defined in Appendix A. Also 


+ loge E (Ger +(2)] <1-Ss1iog, [2 +(9) ## (ata 


and the limit for very large n , using the results of Appendix A, 
is the same for both the upper and lower bound, so that 


lim ( 3 *). H (2) (4. 13) 
n n 


n~ 0 


: 1 n m+2_n-m-2 
<= - -_ 
Es E, = -lim ES log, ( 2)P Q 


This equation gives, for very large n , the value of m to be used 
in connection with Equation 4.12. Finer results and firm bounds 
can be found, but they are lengthy. References 27, 28, 33, and 102 
give further details. 


4.4, The Random-Coding Bound 


The bound derived in this section applies specifically to group 
codes for the binary symmetric channel, though Shannon has de- 
rived more general results.'° It is based on the fact that the 
average probability of error for a class of codes can sometimes 
be calculated more easily than the probability of error for an 
individual code, and that some code in the class must be as good 
as average. 

The class of codes considered will include the row spaces of all 
matrices of the form [l,, P] where I, isa kXk identity 
matrix and P isa kX (n - k) matrix of 0's and 1's. Each of the 
2k(n-k) possible matrices P describes a different binary group 
code, though there are in general many equivalent codes with 
different matrices P . An upper bound is described for the 
average probability of error for all these codes, weighting them 
equally. 

As a first step, the number of codes containing a given n-tuple 
as a code vector is required. The 0 vector is in every code. Ifa 
vector v has all 0's in the first k symbols (the information sym- 
bols), but does not have all 0's in the last n - k symbols (the 
parity-check symbols), it cannot be a code vector in any code, If, 
however, v_ does not have all 0's in the information places, then 
there are 2(K-1)(n-k) codes containing v as acode vector, This 
can be seen as follows: If the given vector has more than a single 
1 in the information symbols, rows of the generator matrix should 
be added until there is only a single 1 left among the information 
symbols, The vector v' derived in this manner is a code vector 
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if and only if the original vector v was a code vector. Since it 
has only a single 1 in the information symbols, it must exactly 
match the row of the generator matrix which has a 1] in the same 
component. The other k - 1 rows of the generator matrix are ar- 
bitrary, but once they are chosen, this row is completely deter- 
mined if v is to be a code vector. Thus (k - 1)(n - k) elements of 
P can be chosen arbitrarily, and 2(k- itn k) codes can be con- 
structed that contain v as a code vector. 

Now consider an error-pattern vector v that has j 1's of which 
r are inthe information symbols. This error pattern will result 
in erroneous or ambiguous decoding if there is any other vector 
v' with j or fewer 1's in the same coset, that is, such that v + v' 
is a code vector. This will happen for any v' of weight j or less 
with exactly 2(k-1)(n-k) codes if v +v' has any 1's in the informa- 
tion symbols, but it will happen for no codes if the sum has no I's 
among the information symbols. Of the : vectors containing i l's, 

ioe have information symbols identical with those in the error 
pattern; the sum of each of these with the error Pate has no I's. 
in the information symbols. This leaves Shed ] vectors, 
each with i 1's for which the sum with the error taitern does not 
have all 0's among the information symbols. Let N(j, r) denote the 
number of codes for which a particular pattern of j errors with r 
errors in the information symbols will result in error or ambiguity. 


Then 
Maine ) A) bi a) (4. 14) 
x 


(Note that the equality would hold pir if for each code for which 
there is ambiguity or error with a particular pattern of j errors, 
there is only one other error pattern of weight j or less which is 
in the same coset. Otherwise codes are ioral afar many 


times in Equation 4.14) Also, since there are 2 (n-K) codes in 
the class under consideration, 
k(n-k 
RGi.thxeeee” (4. 15) 


and whichever bound is smaller should be used to obtain the closest 
estimate. 

Tack pattern of j errors has probability oe © , and there 
are Ne pet patterns with j errors, of which r errors are 
in information symbols. Summing over j and r and dividing by 
2 k(n-k) , the total number of codes, give the probability of error 


or ambiguity: 
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be 
e.* f Pe saps r) (5) ae, PIQ™J (4.16) 
j=0 r=0 


An upper bound is found by substituting Equation 4. 14 or 4. 15 
whichever gives the better bound, in each case for N(j r) ets 


that for j=0 , N(j, r) =0 and i i 
OTE PRLS ’ sO In any case the leading term 


Asymptotic results for this case are more complicated. An 


upper bound, not quite so close, will sti i 
: ; till 
ie Eenied wie eee result if the second term 


i < 5(k-1)(n-k 
ee SAP igus vhs Lae (4.17) 


i=0 


aus bound should be used in preference to Equation 4. 15 for all 
J=m , where m is the largest integer for which 


aa | 
2k(n-k) > 2(k- 1)(n-k) n 
: sae 

iz] 


This condition defines th i i 
ag an € same m as is defined by Equation 4, 1]. 


2 (5c) = Q) 


bere Says merely that the total number of patterns of j errors is 
(5 ) , can be used together with Equations 4. 15 and 4. 17 to give 


m 4] n 

Pp < 2 n-k) n n jan-j : es 

ri d (7)] (Gren Fs > (j) Ph? 4.18) 
j=0 i=0 jem+1 


fon but simple upper bound can be obtained by replacing 
each sum by the product of the largest term by the number of terms 


Thus 
j 
¥ (Jeusn(2) 
‘ j 
ied 
if 2j<n , and 
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sh (3) planes x{*) poe (4. 19) 
i m 
j=emtl 


if m>nP , since then f=) Sey Pas greater than any term in 
the sum. For the other sum, 


m 
2 . . 
27(n-k) 3 (+1) ) plan) (4. 20) 
=0 


two cases are important; the largest term may or may not be the 
last. The ratio of the (j + 1)8* to the jth term is 


P(n - j)? (j + 2) 
Q(j + 1)? 
and the largest term occurs when this ratio is as close as possible 
to unity. Again ifthe n and j are large, so that the 1 in the 
denominator andthe 2 in the numerator can be neglected, this 


ratio is unity for 


NP (4, 21) 


=P 2: SoS 
c NP +NQ 


i=] f= 


If ‘mun Sto 5 the largest term in Expression 4,20 is the last, 
and Expression 4.20 can be bounded by the product of m+ 1 and 
the last term. 


pag ben C86 ¢ 3 


Mee thane ee ‘aa Ae alone ae ie 


n 
av m m 
Now consider the resulting bound on reliability E for the best 
code. It is certainly as good as the average for all codes. 


we At ‘ reoait ~(n-k 
ge nim? 105, (2)p™a” - -lim — log, & 2 (n 2) + 


no noo 


The first term is, in the limit, E(m/n,P) , the function defined 

in Appendix A and the same function as was found as a lower bound 
for E by the sphere-packing bound. The second term can be 
shown to be 0 if use is made of the fash thay, since m is defined 


by Equation 4. 11, 2) ig less than 2 n-K) : 


If m/n>Pe. ,; the largest term in Expression 4,20 is not the last 
but rather the one for which j//n® P, , Then Expression 4. 20 can 
be bounded by 
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-(n-k) nul\t. ene 
2 n nQ 
nP (a Pie Or 4S (4. 22) 


phate oma Po . From the fact that m> nP, , it can be 

shown that the ratio of the sum in Equation 4, 19 to this expression 

i a sane 0 for very large n, and therefore the second sum in 
quation 4. 18 is negligible in the limit if Expression 4. 22 is used 


asa bound for the first sum. Then with the use of Appendix A 
> 


1 
ES Aim =2 > ae 
= log, P| 2H (2) -H(P_) + E(P,, P) (4. 23) 


n~o 


This bound on reliability is definitely lower than the sphere-packi 
bound, In spite of the fact that very crude and simple peckdcd., ig 
been used here, no better estimate of reliability is known for Vi 
m/n > 1 Of course, much better bounds can be obtained f 

the probability of error, but they are more complex. Mo oan i 
can be found in References 27, 28, 40, and 102. igo 
The quantity k/n, the fraction of the symbols that are infor 

tion symbols, is called rate. Consider the maximum rate for any 
which the reliability is greater than 0 for a given value of P d 
in the limit for long codes, By Equation 4. 13, maximizing ia 


means minimizing m , Certainly m can be less than nP so 
that E hes E(m/n, yr From the definition of this tadciion in 
Appendix A, it can be seen that E > 0 if and only if m/n>P 
or H(m/n) = 1-k/n >H(P), or ; : 
Ke1- HP) 
2 (4, 24) 


Piboeikps is piace anes will approach 0 as n approaches infinity 
ne s a e of length n , provided Equation 4, 24 is satisfied, 
18 18 a special case of Shannon's fundamental theorem for nois 
channels. The quantity 1 - H(P) is the channel Capacity, and it ‘ 
Care. to make the probability of error as small as desired by 
be py iy enough codes, provided the rate is less than the chan- 

This bound has been extended by Elias?” to some more restricted 
classes of codes, convolutional codes and sliding peateuiine! 
codes. It is interesting to note also that fairly good codes can b 
found by choosing a modest number of codes at random and kee . 
the best. Encoding is fairly easy for these codes, and they fiw 


might well be used except for the difficulties involved in decoding 
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4.5. Discussion of Bounds 


Upper and lower bounds have been given that can be interpreted 
as bounds on the minimum distance d possible for an (n, k) code. 
As n becomes very large, if the rate k/n is kept constant, the 
bounds on the ratio d/n become fixed constants independent of n, 
and these bounds are plotted in Figure 4. 1. 

The Hamming codes, and the equivalent highest rate Reed-Muller 
and Bose-Chaudhuri codes described in later chapters, meet the 
Hamming bound and are optimum. The MacDonald codes and the 
lowest rate Reed-Muller and Bose-Chaudhuri codes meet the Plotkin 
bound. Hence these codes all have maximum minimum distance. 
For large n their rates all approach 0 or 1, however. In the 
middle rate range, for both the Reed-Muller and the best available 
estimate for the Bose-Chaudhuri codes with any fixed nonzero rate, 
the ratio d/n approaches 0 as n approaches infinity. The Bose- 
Chaudhuri codes, however, still lie approximately on the 
Varsharmov -Gilbert bound for n= 1023. There is no known cod- 
ing system for which it has been proved that d/n remains finite 
as n approaches infinity with the rate k/n held fixed, though the 
Varsharmov-Gilbert bound shows that such codes exist. 

Now consider codes for the binary symmetric channel. By 
Shannon's fundamental theorem for the noisy channel, it is known 
that for any rate k/n less than channel capacity 1 - H(P) there 
exist codes for which the probability of error is arbitrarily small. 
Yet only one nonrandom coding system, Elias! error-free coding 
described in Section 5.8, is known to be capable of achieving error 
probability approaching 0 and maintaining a rate that does not ap- 
proach 0 as the code length n is increased; and the rate for Elias 
coding system is significantly below channel capacity. 

There is one more noteworthy fact. The number of errors 
occurring in a block of n symbols in a binary symmetric channel 
has a binomial distribution with mean nP and standard deviation 
\nPQ . The fraction of positions in error then has mean P and 
standard deviation VPQ/n . As n approaches infinity, the 
standard deviation approaches 0, and for a fixed value of Py >P, 
the probability that Py) n or more errors will occur approaches 
0. Onthe other handif P,=P , the probability that Pon or 
more errors will occur certainly does not approach 0. Thus a code 
that corrects all error patterns with nP) or fewer errors and no 
other error patterns will have probability of error approaching 0 
as n approaches infinity if and only if Po>P . The rate for such 
a code is bounded by the Plotkin bound to a value below channel 
capacity for P greater than 0. 156 REM , the point at which the 
curves intersect in Figure 4.1, (The channel capacity C = 1 - H(P) 

is the same as the Hamming upper bound, which is plotted together 
with the Plotkin bound in Figure 4,1,) Another way of stating this 
is that a coding system that achieves channel capacity with 
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P> 0.156349 must do so by correcting most combinations of d 


or fewer errors even though it is possible to correct all combina- 
tions of errors only up to (d- 1)/2 , where d 


is the minimum 
distance. 


Thus the best codes known now, while they look very promising 
for practical applications, fall Significantly short of theoretical 
limits, and it certainly would be of great theoretical interest to 
find explicit constructions for codes that achieve at least what the 
bounds indicate is possible. Whether such codes would be of practi- 
cal interest would depend on whether such codes could be imple- 


mented practically. Little is known about theoretical limits on the 
amount of computation involved in decoding. 


4.6. Bounds for Burst-Error-Correcting or Burst-Error~-Detecting 
Codes 


A burst of length d is defined as a vector whose only nonzero 


components are among d_ successive components, the first and 
last of which are nonzero. 


Theorem 4.6, A linear code that has no burst of length d or 


less as a code word must have at least d parity-check sym- 
bols, 


Proof: If no burst of length d is a code vector, no two vectors 
that are 0 except in their first d symbols could be in the same 
coset, because, if they were, their difference, which must be a 
burst of length d or less, would have to be a code vector. The 
number of vectors that are 0 except in the first d symbols is q 
and therefore there must be at least q 
check symbols. 


, 


cosets and at least d 


QED 


Theorem 4.7. For detecting all burst errors of length d or 


less with a linear code of length n , d parity-check symbols 
are necessary and sufficient. 


Proof: The necessity follows from Theorem 4.6, The suf- 
ficiency follows from the fact that all bursts of length d or less 
are detected by a code in which the first n-d symbols are in- 
formation symbols and the last d symbols are parity-check sym- 
bols, chosen to make O the sum of each of the d sets of symbols 


consisting of one of the first d symbols and every at 


symbol 
following it. 


Then at most one of the nonzero symbols of a burst 
error of length d or less can affect any particular parity check, 


and so every such burst error will be detected, along with many 
other error patterns, QED 
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The parity-check matrix for such a code for as 23 and d= a. 
shown in Figure 4.2, and a method of mechanizing it which uses 


GTO OOS, 0 EGE 1000 Pople Poor rei 
iocdectiedap del ss oh tak Wapiti ie seit iraeae 

H= Ped Visi Eredar Oo ADB OD i 
POO nl Aes ENR D |G MD GD ohana 
000010000100001000010 

Figure 4. 2. Parity-check matrix for a (23, 18) binary group code 


detecting all burst errors of length 5 or less 


shift register is shown in Figure 4. 3. This is an elementary ex- 
ample of a cyclic code, the subject of Chapter 8. 


Input 


Figure 4.3. Shift register for calculating parity checks for code 
shown in Figure 4. 2 


Theorem 4.8. In order to correct all burst errors of Misc JOR 
b or less, a linear code must have at least 2b eer: a 
symbols. In order to correct all bursts of egies b= on ha ‘ 
and simultaneously detect all bursts of length Ge iD: ee ; 
linear code must have at least b +d parity-check sym ‘ 


Proof: Any vector that has the form of a burst of eee ne 
i i f two bursts of leng 
less can be written as the difference o oti ; ae 
i f a burst consisting of a sing 
except in the degenerate case 0 
Bee Siok wiad Since in order to correct all cent of yest 
i i t cosets, their difference can 
or less these must be in differen sn 
flength 2b or less cann 
d ord, Therefore a burst 0 ; 
pe ot nite! The first part of the theorem (including the exceptional 
a . 
4.6. 
se) then follows from Theorem 4. ' 
agra co every burst of length b +d or less can be epee 
the difference of a burst of length d or less and a burst . : g 
b or less. If the code is simultaneously to an ae : $< 
bursts of length ; e bu 
th b or less and to detect all 
win b and the burst of length d must be in ta tay eee 
and their sum must not be a code word. This theorem then bey 
lows from Theorem 4. 6. . acids 
Another lower bound on the number of parity checks require a 
i all bursts of b or fewer errors can 
a linear code that corrects all et 
burst of length b or less mu 
found by noting that, since every 
in @ diftexent coset, the number of cosets is at least as great as the 
number of burst-error patterns of length b or less, 
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There are (q - 1)n different bursts of length 1, since the nonzero 
component may appear in any one of n symbols and any of the 
q- 1 nonzero field elements. There are (GS. Net 2 1) possible 
burst errors of length 2, since each of the two nonzero components 
may be any of the q - 1 nonzero field elements, and the burst may 
start in any position except the last. For bursts of length? ti 1. 
there are (q - ik (n - i+ 1) patterns, since there are q-1 
choices for each end symbol, q choices for the symbols in between, 
and (n - i+ 1) possible starting positions. The total number of 
error patterns, including the pattern of all O's, is therefore 


b 
L+aq- 0+) (q-aim2(a-i+1) 
i=2 


By use of the two identities 


bok ee n 
# n 
ae te Tee WORE. TRS A Wee chy 
eat Se ce ts id ; btn Cle 
3 ax y * dx ( l-x \(4.28) 
i=0 i=0 


the expression for the total number of error patterns can be sim- 
plified to 


b-1 
q [(q- 1) (n-b+1) 41] 


and, since there must be at least this number of cosets, the fol- 
lowing theorem holds: 


Theorem 4.9. The number of parity-check symbols in any linear 
code that corrects all bursts of length b or less is at least 


Bie. St Ae oh 01 d)de mbt Bhat a 


Some of the codes described in Chapter 10 require the minimum 
or very few more than the minimum number of parity checks indi- 
cated by these theorems. 

A bound analogous to the Varsharmov-Gilbert bound can be found 
for burst-error-correcting codes. Suppose that the matrix H of 
parity-check rules is being constructed for a code to correct any 
single burst of length b or less. It is necessary and sufficient 
that no code vector consist of the sum of two bursts of length b 
or less. Thus, by Theorem 3.1, it is necessary and sufficient 
that no linear combination involving two sets of b or fewer 
consecutive columns of H be 0. Suppose that n- 1 columns hy , 


he ,..., hy. have been chosen, Then any column hy, may be 
added, provided that it is not a linear combination of the last b- 1 
columns ha.p4+],...+, hn«] and any set of b consecutive columns 


among h, ,..., An.b! 
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The worst conceivable case would be for each choice of coefficients 
a; and b; to yield a distinct sum in Equation 4.26. There are 
qo=i choices for the a; . The coefficients b; form a burst of 
length b or less in a vector of length n-b , and by the argu- 
ment preceding Theorem 4.9 it can be seen that there are 

qe-} [(q - 1)(n - 2b + 1) + 1] choices for these coefficients, including 
the case in which they are all 0. Thus the total number of choices 


of coefficients is 


ae tg? tte: <a) (=i 2s aad 
If the number of possible vectors of length n -k is greater than 
this, there certainly must exist a vector h, satisfying Inequality 
4.26 for all choices of coefficients, and thus it is possible to con- 
struct a code of length n which corrects all bursts of length b 
or less. Since there are qa-k vectors of length n-k, this is 


possible if 
aks q?')-1) [iq - 1) (n - 2b + 1) + 21] 


This can be summarized as follows: 


Theorem 4.10. There exists an (n, k) linear code that cor- 
rects any single burst of length b <n/2 or less if the number 
of parity checks satisfies the inequality 


n- k > 2(b - 1) + log, (a= 1 (n= 254 1) Fay (40275 


NOTES 


The Plotkin bound is taken from Reference 90. (See also Reference 65.) 
The bound that I have called the Varsharmov-Gilbert bound was found by 
Varsharmov.?!? It is a refinement of a bound of Gilbert's, 47 and was also 
found by Sacks}°° Sacks' proof is used here because of its simplicity. The 
Hamming bound appears in Reference 58 and a refinement of it in Reference 
114. Both random coding and Gilbert type bounds for other classes of codes 
are derived in Reference 121, 

The material on the binary symmetric channel is taken from work done by 
Elias. Further details can be found in References 27, 28, and 40. Shannon!” 
has also found bounds for the probability of error for more general channels. 

On bounds for burst-error detection and correction, results equivalent to 
Theorem 4,8 appear in Reiger?’ and are similar to some results of Fire. 37 
Theorem 4,9 appears in Fire's paper, Theorem 4,10 was found by C. N. 


Campopiano, 


PROBLEM 


4,1, Show that for a code of any length n , b parity-eheck symbols are 


necessary and sufficient for correcting all burate of erasures of length b 


or lewa, 





Chapter 5 


IMPORTANT LINEAR CODES 


In this chapter several binary codes that are well known as 
noncyclic codes are described. Of these, the best known is the 
Hamming code. 


5.1. The Hamming Codes 


The binary Hamming code is most easily described in terms of 
its parity-check matrix. Consider a matrix H of 1's and O's, 
which has m rows and 2™ - ] columns, the column vector's 
being all possible m-tuples except the 0 m-tuple. Over the field 
of two elements, if two vectors add to 0, they must be equal. 
Therefore no two columns of this matrix add to 0, and, since the 
only nonzero scalar is 1, no linear combination of two columns is 
0. Therefore the null-space of this matrix has minimum weight 
3, and is capable of correcting all single errors. The code 
vectors have length 2™-1, with m parity-check symbols and 
therefore 2™ - 1-m information symbols. 

Since each of the 2™ - 1 single-error patterns is in a different 
coset, these together with the code space account for all the 2™ 
cosets. Therefore this code has as coset leaders the 0 vector 
and all single-error patterns, and no others, and is an example 
of a perfect code. The Hamming code can be modified to any 
length n by setting up the matrix H for the smallest m in 
such a way that 2™ - 12n and by simply omitting all but n 
columns. No matter which columns are omitted, the code will 
still have minimum weight 3. It is possible to choose the columns 
so that the resulting code is quasi-perfect. (See Problems 5, 1 
and 5.3.) Thus for every n there is a Hamming single-error- 
correcting code that is optimum for the binary symmetric channel. 

If a code vector u is transmitted and a single error occurs, 
the received vector is u+e , where e is a vector that has a nf 
in the error position and 0's in all other components. Then the 
syndrome is 

(u + ayaer = usin + mr = aif 
since u is a code vector, and therefore in the null space of H 
But since e is a vector that has a single 1 in the position cor- 
responding to the error, the syndrome eH* is just the row of 
H“ corresponding to the error, Thus by comparing the syndrome 
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with the matrix HT , the position of the error can be found, and 
simply changing that symbol corrects the error. A clever way 
of doing this is to use as the ith column of H the binary repre- 
sentation of the number i . Then the syndrome gives, for each 
single error, the binary representation of the position in error. 
This is the arrangement originally used by Hamming. 


Example: For m=3,n=23-12+7 , the parity-check matrix 
may be chosen as follows: 


On eit 4 Lilt 


1 
ms 4Ur ee O Ore LT 
AS OR ae OE 5 O oe ak 


It is easy to encode if the first, second, and fourth symbols are 
taken to be the parity-check symbols, since each is involved in 
only one of the parity-check relations described by H . To 
encode information symbols 1100 , three parity-check sym- 
bols pi; p21p,;100 are inserted. Then p, is chosen to satisfy 
the parity relation given by the last row of H; that is, 


pt+l+1+0=20 


Therefore p,; = 0. Similarly pz = 1 and p,=1 , and the code 
vector is 0111100 . Ifthe fifth symbol is received in 
error, the received vectoris 0111000 .. The syndrome 

is easily foundto be 101 , a value that matches the fifth 
column of H_ , indicating an error in the fifth symbol of the 
received vector. The syndrome is the binary code for 5, since 
each column of H was chosen as the binary representation of 
the column number. 


A binary code with minimum weight 4 can be formed by adding 
to a binary Hamming code one parity check that is a check on all 
the symbols in the code. In fact, adding one check symbol that 
includes all symbols to any binary code will always adda 0 to all 
words of even weight, a 1 to all words of odd weight, and therefore, 
if the minimum weight in a code is odd, the over-all parity check 
increases the minimum weight by 1. There are m+ 1 parity- 
check symbols, 2™ -m - 1 information symbols (the same as 
for the single-error-correcting code), and therefore a total of 
n= 2™ = symbols. 


Example: The parity-check matrix for the Hamming (8, 4) 
single-error-correcting, double-error-detecting code is 


mes ee ° aie ie ae eae | 
oe ok oe Oy ole 
OL. cin gd cities Ged 





ase 
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Decoding for this code is accomplished in the following way: 


1. If the syndrome is 0, assume that no error occurred. 

2. If the over-all check (corresponding to the last row in H 
in the example above) is 1, assume that a single error 
occurred, The syndrome will match the column vector in 
H corresponding to the error. 

3. If the over-all check symbol is 0, but other parity checks 
fail, an uncorrectable error has been detected. 


The distance-4 Hamming codes can be shown to be quasi-perfect 
(Problem 5.2). Again it is possible to omit columns from the 
et Nala matrix so as to form a distance-4 code of any length 
n< 

At first sight it might appear that to generalize the Hamming codes 
to codes with symbols taken from the field of q >2 elements it 
would be necessary only to take as the parity-check matrix H an 
m X q™ - 1 matrix in which the columns are all possible distinct 
m-tuples. This does not work, since now some nontrivial linear 
combinations of two columns are 0. For example, over the field 
of three elements, (2, 1) and(1, 2) addto(0, 0). The difficulty 
is that (1, 2) is a scalar multiple of (2, 1). In the binary case the 
only scalars are trivial. 

The difficulty is overcome if, out of each class of vectors that 
are scalar multiples of each other, only one is chosen, say the 
one having a 1 as its first nonzero component. Then no two 
columns of H are linearly dependent, and the null space of H is 
a distance-3 code, capable of correcting any error involving a 
single component. There are altogether q™ - 1 nonzero m-tuples, 
of which a fraction 1/(q - 1) have their leading nonzero element 


“en to 1. The maximum number of columns in H is therefore 
(q = 1)/(q - 1). 


Example: A code with symbols from the field of three elements, 
with three parity-check symbols, is the null space of the matrix 


OHO NOs SOPSTO IN, FEF wee ae ae eee g, 
Ls Aaa 1) ine me Um PRE 09 RO) TL a HM ee em. 
OFT 2 


LO) EM. ee ee OPES 2 PaO) 


This code of (3? - 1)/(3 - 1) = 13 symbols, of which 10 are in- 
formation symbols, can correct any error in any single symbol, 
It is simple to encode if the check symbols are taken to be the 


first, second, and fifth, corresponding to the columns with only 
one nonzero element. 


If a code word u is transmitted and an error amounting to 
adding b to the jth symbol in u occurs, the received vector is 
ute , where e is a vector with b in the jy fymbol and 0's 
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elsewhere. Then the syndrome is 


(u + e) Ho = ae + i = orc 


h column of H , multi- 


which is merely the transpose of the jt 
plied by b . The syndrome will therefore have b as its leading 
nonzero symbol. Then decoding can be effected by dividing the 
syndrome by its leading symbol b . The resulting vector will 
match the column of H corresponding to the position of the error, 
and correction is accomplished by subtracting b from this sym- 
bol in the received vector. 

A generalized Hamming code with the maximum number 
n = (q™ - 1)/(q - 1) of symbols is perfect, since the n(q - 1) = 
q™ - 1 single-error patterns and the 0 vector must all be coset 
leaders, thus accounting for the total of q™ cosets. (See Prob- 
lem 5.3.) 

The dual of a Hamming single-error-correcting binary code is 
a MacDonald code. The dual of the distance-4 Hamming code is a 
MacDonald code, or equivalently a Reed-Muller first-order code. 


5.2. Weights of Code Words in Hamming Codes 


In this section, formulas are derived for the number of vectors 
of each weight in binary and nonbinary Hamming codes. These 
formulas are useful for evaluating the probability of an undetected 
error when a code is used for error detection only. The weights 
for the Hamming code with elements from the field of q elements 
and with length n = (q™ - 1)/(q - 1) are found by use of the cor- 


respondence between linear dependence relations among w columns 


of the parity-check matrix H and code vectors of weight w 


(Theorem 3.1). The number of code vectors of weight j is denoted 


w(j) 

Any vector of m symbols is a multiple of some column of H , 
and therefore, by adding a multiple of some column of H , any 
nonzero linear combination of j - 1 vectors can be made into a 
linear combination that is‘0. The new linear combination would 
ordinarily have j terms, but it is possible that the newly added 
term would cancel one of the old terms. This would happen if and 
only if the original linear combination of j - 1 vectors consisted 
of a 0 linear combination of j - 2 vectors and one additional term. 
It is also possible (except in the binary case) that the newly added 
term would combine with one of the other terms but not cancel. 
This would happen if and only if the linear combination of j - 1 
vectors consisted of a 0 linear combination of j - 1 vectors with 
a term added that combines with but does not cancel one of the 
terms already there. 

The number of vectors that are zero linear combinations of 
j-2 vectors is W(j- 2) , The number of linear combinations 
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consisting of j - 2 terms that add to 0 plus one nonzero term is The weights for the single-error-correcting, double-error- 

(n - j + 2) (q - 1)W(j - 2) . The number of linear combinations of detecting binary code can be found by noting that each vector of 

j - 1 vectors is (; BR 1) (a - 1)j-i . The number of nonzero linear odd weight has a 1 added to it, while each of even ee ea 
combinations of ‘j - 1 vectors is Gio (qs 1)2- 1. Wiisu le added. Thus the number of vectors of weight j is O if j is odd, 
The number of these consisting of a linear combination that adds to (W(j) + WG - 1)) if j is even. The odd terms and even terms can 
0 with a term added which combines with one term but does not be separated by using [ f(x) + f(-x)]/2 for the even teres, : 
cancel it is (j - 1) (q - 2)W(j - 1) . The number of nonzero linear [ f(x) - £(-x)]/2 for the odd terms. Then the generating function 
combinations of j - 1 vectors to which one more term may be f, (x) for the distance-4 code is 


added to form a linear dependence among j vectors is therefore 4 , 
fy (x) = > (£Gc) + £(-x)) + 5 (f(x) - £(-x)) 
n 


iwi) =(,",) @- Pt wG-- Ga - awe - >» 


and substituting from Equation 5.5, with n increased by 1 because 
Shs A Pa De 9 4) (5.1) of the added parity check, yields 


As is indicated, every linear dependence of j vectors can be and 

is produced from nonzero linear combinations of j - 1 vectors in f; (x) = 
exactly j ways, once for each possible choice for the last term to 
be added, Equation 5.1 is a difference equation in W(j). Since 
the minimum weight is 3, W(0) =1, W(1) = W(2) = 0 . From this 
fact and Equation 5,1, W(3) can be calculated, then W/(4) , W(5) , 
and so on, 


afd 
d Gays - "5 Bi Dae 


2n 
(5. 6) 


Finally, it is interesting to note that the probability of an un- 
detected error is 


An explicit solution is also possible. Let : : 
: inn-i 
n P(undetected error) = ¥ W(i) PQ 
fe) =) wipe! (5. 2) isl 
J=0 = i 
: n : 
Then if Equation 5.1 is multiplied by xJ-1 and summed with =Q > W(i)(P/Q) 
respect to j from j=0 to j=n+2 , with W(n + 1) = W(n + 2) =0, j= 1 
the following differential equation results: 
= Q” [(P/Q) - 1] (5.7) 


f(x) = (1 + (q = I)x)" - £(e) - (q - 2) xf"(x) = n(q - 1) xf (x) Ages: a 
+ x?( 1) f! (5. 3) for the distance-3 code, or the same expression with f replace 
9 2h ‘ by f, for the distance-4 code. 
This first-order linear equation can be solved with the initial con- 


ditions £(0) = 1 to yield Example: There is a binary Hamming single-error-correcting 


code of length n=7 , 











n-1 n(q-1)+1 
f(x) = ——+ _ eke - 1)x)" ay ss flx) = 5 ((1 + x)" + 7(1 +x)? (1 - x)*) 
n(q-1)+1 q- 1)x) +n(q- 1) (1+(q - 1)x) + (1-x) 
(5. 4) = 1+ 7x3 + 7x* + x7 
and the number of code vectors of weight j can be found as the Therefore this code has one code word of weight 0, seven of 
coefficient of iil im thas polynomial, For the binary case, weight 3, seven of weight 4, and one of weight 7. The distance-4 
code obtained by adding an over-all parity check to the single- 
no ail error-correcting code has n®#8 , 
sin laa pelea siti (1 - x) ‘ ies 


fy (x) SACL + xP + (1 = x)? 4 Qin 1) (1-H 


w 1+ l4x* +x! 
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This code therefore has one code word of weight 0, 14 of weight 4, 
and one of weight 8. 


5.3. The Golay (23, 12) Code 


Golay, in a search for perfect codes, noticed that 


23 23 Zo 25 1 
(2) +2) +G)()2 

and that this indicated the possibility of a (23, 12) perfect binary 
code that corrects all patterns of three or fewer errors. He found 
that such a code did exist. It will not be described here, since it 
reappears later as a cyclic code and will be discussed as such. 
(See pages 140 and 167.) 

The number of code vectors for the (23, 12) code and for the code 
formed by adding to it an over-all parity check to form a (24, 12) 
code are listed in Table 5.1. 


Table 5.1. Weight of Code Vectors in the Golay Codes 


Weight Number of Code Words of This Weight 
(23, 12) code (24, 12) code 
0 1 1 
7 2o3 0 
8 506 499 
11 1288 0 
12 1288 2576 
15 506 0 
16 253 39 
23 1 0 
24 0 1 
Total 4096 4096 


The codes that have one information symbol repeated 2m + 1 


times correct all combinations of m or fewer errors and no patterns 


of more than m errors. These trivial codes, the Hamming codes, 
and the Golay (23, 12) code are the only known perfect binary codes, 
There are a number of results indicating that perfect codes are 

scarce, and it even seems quite likely that there are no others.7)»104 


5.4. Optimum Codes for the Binary Symmetric Channel 


The search for optimum codes for the binary symmetric channel 
has so far met with very limited success, The codes with one in- 
formation symbol repeated an odd-number n times are optimum 
in a trivial way, and the Hamming codes provide another infinite 
class, Certain codes found by omitting columns from Hamming 
codes can be shown to be quasi-perfect and therefore optimum, 
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(See Problem 5.3.) Bose-Chaudhuri double-error correcting codes 
are quasi-perfect and therefore optimum.°? The values of n and 
k for other known optimum codes are listed in Table 5.2. 


Table 5.2. Values of (n,k) for Known Optimum Group Codes for 
the Binary Symmetric Channel 
(t = the largest number such that all patterns of t or 
fewer errors are coset leaders) 


Quasi-Perfect Codes 


(n, k) t Reference (n, k) t Reference 

(5,-2) 1 105 (17, 9) 2 Prange (private 

(6, 2) 1 105 communication) 

(8, 2) 2 105 (ZT ehe) iD 92 

(9, 5) 1 105 (21, 14) 1 41 
(10, 5) 1 105 (225,22) 2, 41 
(11, 4) 2 105 (225005) 1 41 
(1,6). 3 105 (38 46) Gd 41 
(14, 6) ve 41 (Z3eulia) 5 49 
(14,8) 1 4l (24,42) 3 49 
(15, 9) 1 4l (25512) 3 41 
C ea A 105 

Other Codes 

(n, k) t Reference (n, k) t Reference 

(7:2) 1 105 (1355) & 41 

(8, 3) 1 105 (13, 6) 1 41 

(9, 2) e 105 (1352) 1 41 

(9, 3) 1 105 (14, 2) 4 41 
(10, 2) 2 105 (14, 3) 3: 41 
(10¥3) 2 105 (14, 4) a 41 
(10, 4) 1 105 (14, 5) fe 41 
(Lik) oI 105 (25: 2) 4 41 
(37573) v3 105 (15,3) | 41 
(11,5) 1 41 75,4) 3 4l 
(12, 2) 3 105 (15, 5) Bi 41 
(25°35) 2 105 (16, 2) 4 4l 
(12, 4) 2 41 (16, 3) 3 41 
(12, 5) 1 Al (16, 4) 3 4l 
(Vese)" 2 4l lina) 4 4) 
(13,2) 3 41 ie) «6S 41 
(13, 3) 4 41 - (18, 3) 4 41 
(13, 4) 2 41 


rR error-correcting codes 


Known optimum codes fall in one of two classes: (1) codes that 
have been found to be quasi-perfect and therefore must be optimum, 
and (2) codes that have been proved to be as good as any other code 
with the same total number of symbols and the same number of in- 
formation symbols. In the latter case, the procedure used was 
typically to obtain as good a code as possible with reasonable effort, 
and then to compare all others with it. Since equivalent codes have 
the same probability of error, only one code in an equivalence 
class had to be compared with the assumed best code. Many codes 
were eliminated quickly on the basis of arguments involving the 
weights of code words. In many cases the coset leaders had to be 
found for many codes, and these codes had to be compared one by 
one. With the best use of present knowledge of coding theory, the 
task is still long and tedious even for short codes. Slepian carried 
such a search as far as was practical by hand and with the aid of a 
CPC computer. The search was extended somewhat by Fontaine and 
Peterson using an IBM 704, but some codes of length as short as 
15 symbols required many hours of computer time and required com- 
paring thousands of codes with an assumed best code. 

Since the sets of weights, numbers in the modular representation, 
and the a; (the number of coset leaders of weight i) are very 
closely related, one is tempted to make several conjectures about 
them. A number of counterexamples have been found, For ex- 
ample, two codes have been found that have the same set of weights 
of code words but different sets of numbers in their modular repre- 
sentation and different sets of aj . The combinations for which 
counterexamples have been found are listed in Table 5. 3. 


Table 5.3, Known Cases of Counterexamples to Typical Conjectures 


Sets of Numbers’ Sets of Weights 


(n, k) in Modular of Set of a's Remarks 
Representation Code Words 

(16, 3) Same Different Different Nonoptimum 

(14, 3) Different Same Different Nonoptimum 

(14, 3) Different Different Same Optimum 

(14, 6) Same Same Different Nonoptimum 

(14, 6) Same Different Same Optimum 


The details are in Reference 41. It is also interesting to note that 
for all known cases except the (15, 3) code the same code is opti- 
mum for all values of channel error probability P less than 
one-half, 
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With a less stringent definition of optimum, Bose and Kuebler 7° 
were able to make limited progress in finding optimum codes. 
They considered a code optimum if it would correct all errors of 
weight m or less, with as great an m as possible, and would 
correct as many errors as possible of weight m+ 1 

The difficulty in extending the search for optimum codes suggests 
that it will be much more fruitful to search for good codes, per- 
haps using the bounds in Chapter 4 as a guide. 


5.5. Reed-Muller Codes 


The Reed-Muller codes are a class of binary group codes cover- 
ing a wide range of rate and minimum distance. For any m and 
r <m _, there is a code in this class for which 


n=2™ 
a Rs he nema 
af ¥ 
(5. 8) 
a-kee(P)+...4 ( ae ) 
1 m-r-1l 
d=2™"* = minimum weight 


The construction of these codes requires a little mathematical 
development. Consider the following set of vectors over the field 
of two elements. Let vo be a vector whose 2™ components are 
all 1's, andlet v, , vz ,..., Vm be the rows of a matrix that has 
all possible m-tuples as columns, as illustrated for m=4 in 
Figure 5.1. Now define the vector product of two vectors as follows: 


u= (ay » AZ peers an) 
v= (b; ’ b2 pie eS b,) (5.9) 
uyr=i(ay byes lasibe 5435, a,b.) 


With this definition, the vectors form a commutative linear associa- 
tive algebra, Finally consider the collection of vectors formed 

by multiplying the vectors v. two ata time, three ata time, and 
so forth up, to m ata time, as illustrated in Figure 5.1. It can 
be shown that these vectors are linearly independent. (Note that 

in Figure 5,1 the rows could be rearranged to form a matrix with 
1's on the main diagonal and 0's below. ) 
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vav3vev1 = (0000000000000 001) 


Figure 5.1. Vectors used as a basis for the Reed-Muller codes 


The r‘}_order Reed-Muller code is formed by using as a basis 
the vectors vo, vi ,... Vy,» and all vector products of these 
vectors r or fewer ata time. Clearly the inner product of two 


vectors is 0 if the number of 1's in the vector product is even, 1 
2 


if it is odd. Also, for any vector v, v° =v . Finally, the only 
product that has an odd number of 1's is the product of all the 
vectors v, ,..., Vm . Thus the vector product of any vector 


in the basis of an rth-order code with any vector in the basis 
for an (m - r - 1)-order code is a vector in the basis for an 

(m - 1)-order code, and therefore has an even number of 1's in 
it. Therefore any vector inthe rth.order code is orthogonal to 
any vector in the basis for the (m +r = 1)«order code, that is, 

any vector which ia the product of m-«r-« 1 or fewer of the 
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vectors v; ,...,Vy, - The sum of the dimensions of these codes 
is n , and hence each is the dual code of the other. It follows 
also that the rth_order Reed-Muller code is the null space of the 


matrix whose row vectors are Vo, Vi 5-++s Vm» and all vector 
products of these vectors taken no more than m~-r - 1 ata time. 
Since the matrix formed by the rows vo, vi » V2 5---» Vy, is the 


parity-check matrix for the Hamming single-error-correcting 
double-error-detecting code, this code is the same as the Reed- 
Muller code of order m - 2 

An important feature of the Reed-Muller codes is that they can 
be decoded in a simple manner. This can best be seen by an 
example. Consider the second-order code for m=4 , Then this 
is a (16, 11) code, and the 11 information symbols ay , a4, a3, 
az» ar , ag3, Agz » Agy> 232 , 231 , Ay are coded into the vector 


A0Vo + AagVg + A3Vz3 + AZV2 + AL V] + Ag3V4V3 + Ag2 V4V2 

+ Ag. V4V1 + A32V3V2 + 231 V3V1 + A221 V2V)1 = (b; sie Fae bn) 
The problem is to determine the a's from a received vector even 
though errors may have occurred. Note that the sum of the first 
four components, as elements of the field of two elements, is 0 


for every basis vector except vzv,; . Thus, in the absence of 
errors, 


b, + bz + bz + by = agi 
The same is true of the next four components, and 


bs + bg + bz + bg = a2) 


and also 
bg + bio + bi + biz =a21 
big + bigtbis +big=a21 
Thus there are four independent determinations of az; . In gen- 


eral there would be 2™~-* independent determinations. Errors 

may cause some of these to be incorrect, but each error can affect 

only one determination, and therefore, if a2, is taken to be equal 

to the value occurring most frequently, with any combination of 

2m-r-l . 1 or fewer errors, a2; will still be decoded correctly. 

Similar determinations of a3, , a32 , a4; , and a4, can be made, 
After these have been determined, 


Ag3V4V3 + Agz VaV2 + Agi VaVi + Ag2V3V2 + A31V3V1 + A21V2V1 


can be subtracted from the received vector, This, in the absence 
of errors, would leave 


r' m MOV + Ogg + AyVy + MgVg + A, Vy # (bY bi,...,b4) 
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and the next set of coefficients can be determined in a similar way. 
There are eight equations that a, should satisfy: 


a, =bh +bh=by+b,=b5 +by =byt+by=by +b 


=bihi + biz =bh43 +b, =bis + big 


Similar equations hold for az , az, anda,. Finally, in the ab- 
sence of errors, 


r! = agv4g - A3V3 - agVz2 - a, Vy = AQVo 


This should be all 0's if ag = 0, all l's if ag =1 , and ay 
can be taken to be whichever occurs more frequently. 

Since this decoding system can correct all combinations of 
2m-r-1_] or fewer errors, the minimum distance must be at 
least 2(2M-r-1-]) + 1=2M-T_] | and, since the code vectors 
all have even weight, it must be at least 2™~* . But the last 
basis vectors have weight 2™-* | so this is exactly the minimum 
weight. 

The scheme for determining which sums of symbols in the re- 
ceived vector should equal a given information symbol can be 
described as follows. Arrange the symbols in each of the original 
vectors v, ,..., Vy,, as in 5.1, and call the component cor- 
responding to the jth O in vj and the component corresponding 
tothe jth 1 in v; matching components for v; . Then the 
2m-1l sums of matching components of vj are used in determining 
aj. The 2™°* sums of four components used to determine aij 


are found by taking a matching pair of components for v; » and 


with each of them the component that matches for ve ie Similarly, 
each determination of ijk is a sum of a pair of matching com- 
ponents v; , together with their matching components for vio 
and the matching component for v, for each of these, to make a 
total of eight components. The process can be continued in a simi- 
lar manner. 

These codes have an interesting geometric interpretation. 
Consider a space of n dimensions in which the coordinates are 
elements of the field of two elements. There are 2™ points, 
and each column in Figure 5. 1 corresponds to one of these points. 
The vector v; has a 1 for all points that have their ith coordinate 
Xj; equal to 0, thatis, for every point in the (m - 1)-dimensional 
X;-hyperplane. (This is an incidence vector.) The vector ViVj 
has a 1 for every point that is in both the X; and X; hyperplanes, 
and hence is the incidence matrix for an (m - 2)-dimensional flat 
through the origin, and so on, aE 

Since the rth-order code is the null space of the (m - r - 1) - 
order code, each product of m-r- 1 or fewer vectors vi 
defines a parity-check rule, Geometrically, if the symbols of the 
code are placed at the corresponding points in the m-dimensional 
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space, each parity-check rule is a parity check on the symbols 
associated with the points of an (r+ 1) - or greater dimensional 
flat through the origin, and every such flat gives an independent 
parity-check rule. 

The decoding method has the following geometric interpretation: 
Each basis vector in the code is a product of r or fewer vectors 
Vy +++, Vm- An r-dimensional flat has 27 points, and hence 
a product of r vectors v,; has 2™-* 1's. Now through each of 
these points there is a perpendicular flat of r dimensions, or rae 
points. These are the sets of points that correspond to the sums 
used to determine the information symbols during decoding. Such 
a set of points will serve that purpose if its incidence vector has 
an odd number of 1's in common with the vector whose coefficient 
is to be determined but an even number in common with all the other 
vectors that are products of r or fewer of the vectors vj , be- 
cause then in the sum the desired coefficient will not drop out, but 
all others will cancel. These sets of points have this property be- 
cause, being perpendicular to the given flat, each intersects it in 
one point, but each intersects every other flat of dimension r 
or more either not at all or in a line or higher dimensional flat 
and so has in common with it an even number of points, 2) , where 
j is the dimension of the intersection. 

This geometric interpretation suggests a generalization in which 
the parity-check matrix consists of all incidence vectors for 
(m - r) - or fewer dimensional flats through the origin of an 
m-dimensional space over the field of q elements. This would 


yield a q-symbol code with n=q™ , 


k=1+ otis the) 


minimum weight d=q™-T , and witha simple decoding scheme 
based on the fact that the sum of q equal terms is 0 in the field 
of q elements, justas X +X =0 inthe field of two elements. 


5.6. MacDonald Codes 


MacDonald found, using properties of the matrix C described 
in Section 3.5, that many (n, k) binary group codes for which the 
modular representation consists of (2K - 1 - s) 0's followed by s 
l's have maximum minimum distance, as indicated by the Plotkin 
bound. (The matrix C = MIM , where M is a matrix whose 
columns are taken here to be all possible vectors of k binary 
digits in sequence as binary numbers, as in the example in Section 
3.5.) The various cases for which MacDonald was able to prove 
maximum minimum distance are summarized in Table 5,4. 
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Table 5.4. Summary of MacDonald Codes is the largest integer satisfying the Plotkin bound, and therefore 
no code with the same length and same number of information sym- 
zB eet a (N) bols could have larger minimum weight. 
k : : 
h#— 2 - 1 5.7. Codes Derived from Hadamard Matrices 
k ae (1,1, 1 1, 1,1) 
Zeeul: 2 a pes ge! A Hadamard matrix is an orthogonal n X n matrix whose ele- 
Soe cee eee 8g 
ments are the realnumbers +1 and -1. An orthogonal matrix is 
2k ao 4 a matrix whose rows are orthogonal n-tuples (over the field of real 
ok a” 2k-1 <a Wind Boren ae) numbers in this case). 
Theorem 5.1. If there exists an n X n Hadamard matrix, 
2* a3 l there exists a binary code with n symbols, 2n code vectors, 
k k-1 and minimum distance n/2 . (This is not necessarily a 
2-3 2 -2 (COLO sel ga megrlsehsal) 
linear code.) 
Bien’ = 2* - 2u | Proof: Let H bea ; opr matrix. The code is constructed 
of 3 ok-1 " 2u-1 6G 43, AYO. ad hes 0, AD as follows: Forma set of 2n vectors Vi 5 V25+809 Vad =¥L > 
“V25 s+.5 °V, 5 Where v; , v2 ,...) Vo averthe rowslor BH . Then 
Noten ei s)2, 39454 2c le ne : n n ; 
in each of these change the 1's to 0's, andthe -1's to 1's. This 
gives a set of 2n vectors of n binary symbols each. Since cor- 
. u 
-— 2 - 1 —| i }e2k - Se i+ responding components of v; and -vj are different, the distance 
2k pala 2k-1 : uel cell CO Oe eyo Om Usb ilsistsctn son lL) ‘ between vj and -vj is n . Since +v; and +v; are orthogonal 
NOte 253 Src nol if i#j, they must match in half the positions and differ in the 
other half, and thus the corresponding binary vectors are at dis- 
As a simple example of the proofs involved, consider the third tance n/2 
type of code listed in Table 5.4, It is obtained essentially by QED 
omitting the first two columns from the matrix C , and it was : 
shown in Section 3.5 that in one-fourth of the rows these columns Theorem 5. 2. If H is an nXn Hadamard matrix, then the 
both have 1's, in one-half of the rows there are a 0 anda 1, andin matrix 
the rest both have 0's. Each nonzero row of the matrix C has H H 
2°"" 1's, and therefore the weights of the vectors obtained by H' = <r 
omitting the first (or in fact any) two rows of C are one word of ; 
weight 0, 2-* words of weight 2k-1- 2 , 2k-1 words of weight is a 2n X 2n Hadamard matrix. 
2e-1'_ 1, and 28-*- 1 words of weight 2k-l | The minimum Proof: The matrix H' is clearly a square matrix with +1 and 


weight is 2k-1_ 2 
The Plotkin bound (Theorem 4, 1).indicates that the minimum 
weight must be less than or equal to ngk-1 (q - 1) /(q¥ - 1) 


-1 as elements. The dot product of the jth and (n + j)th rows 
(j Suis 


Consider the difference, noting that n = 2k _ 3 and qg=2Z2, (vi, vJ < (v,, = v) - ‘5 : % a af : Sy =n-n=0 
(2 - 3) 2k-1 £4 22k-1 Bg 2k-1 J 22k-1 $2x2% 4 26-1} -2 For any other combination of rows, 
k a iid ulin cceiniin k (v., tv.) + (v., #v.) = v.tv =0+0=0 
one Pau ee ee oe Ny ® 4 
ae 2 and thus H' is an orthogonal matrix. 
= S Mester ee aa QED 
> ee | 


It is easily verified that 
Since the difference between the Plotkin bound and the minimum 1 i 
weight of this code is less than 1, the minimum weight of this code H, = ° 4 
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is a Hadamard matrix, and therefore 


1 1 1 1 
eos! ‘tes ) 
ie Ss 1 lime etl 
lipcaie ot 1 


is also, by Theorem 5.2. By repeated application of Theorem 

5.2, a 2™x2™ Hadamard matrix Hm can be constructed for 
any positive integer m . The resulting code is the same as a first- 
order Reed-Muller code or a MacDonald code. In fact, the seven 
nonzero code words in the code derived from H, match exactly 

the last four columns of the matrix C on page 43 , and there- 
fore the code has a modular representation (0, 0, 0, 1, 1, 1, 1). 

It is true in general that the codes derived from H,,, have a modular 
representation vector consisting of (2m-1 - 1) 0's followed by 

2™-/ 1's if the matrix M in Equation 3.8 has its columns ar- 
ranged in order as binary numbers. 

For other values of n , the binary code derived from a Hada- 
mard matrix cannot be a group code, since the number of code 
vectors is not a power of 2. It can be shown easily that if n is 
greater than 2, it must be a multiple of 4. Methods af constructing . 
Hadamard matrices have been found by Paley,” Bose,’ William- 
‘aoe Brauer,'* and Stanton and Sprott.1°8 The existence of 


Hadamard matrices H,, has been proved for the following values 


of m , where p denotes an odd prime integer: 
IL m= 2X, 
k 


II. m-=p +1, if this is a multiple of 4. 


Pr om = my; am + 1), where m, 2 2 is the order of a 
Hadamard matrix. 
IV. m =m*(m* - 1), where m* is a product of 
numbers of forms I and II. 
Ve asimiseal 72% 
VI. m =m*(m* + 3), where m* and m*+4 are 
products of numbers of forms I and II. 
Vil, ‘m:= mm,(p* + 1)p* » where m); 2 2, mz Zz 2 
_ are orders of Hadamard matrices. 

VII. m =m,m;s8(s + 3), where m;2 2, m2,2 2 
are orders of Hadamard matrices and where s 
and s + 4 are both of the form pk +1 

IX. m=(q+1)* , where both q and q+2 are 
prime or prime powers, 
X. m is a product of numbers of the form I to IX, 


This list is taken from a paper by Bose and Shrikhande, 3 which 
gives further details also on the binary codes, These methods 
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enable construction of Hadamard matrices of order m for all 
values of m that are less than 200 and divisible by 4 except 116 
and 156.* However, the existence of a Hadamard matrix has not 
been disproved for any m which is a multiple of 4. 


5.8. Iterated Codes 


It is possible to combine the use of two or more codes so as to 
obtain a more powerful code. For example, a single parity check 
on a vector is capable of detecting all single errors. Now con- 
sider information symbols arranged in a rectangular array, as 
shown in Figure 5.2, with a single over-all parity check on each 
row andeach column. This iteration of a simple parity-check 


Information Checks 
Symbols on Rows 


Checks on Checkson 
Columns Checks 





(a). General arrangement (b). A binary iterated code 


Figure 5,2. Structure of iterated codes 


code is capable of correcting all single errors, for if a single 
error occurs the row and column in which it occurs are indicated 
by parity-check failures. In fact, this code, which is a linear 

code, has minimum weight 4, the minimum weight code word having 
nonzero components at the intersections of two rows and two 
columns. This code is actually used for error detection on mag- 
netic-tape units used with IBM computers. 

An important generalization results if each row of the array is a 
vector taken from one code and each column a vector from a dif- 
ferent code, Iterated codes can also be generalized to three or 
higher dimensional arrays. These are all linear codes. Iteration 
of codes has been called the product of codes by Slepian, since 





* The numbers 92 and 184 are not covered by this list, but a Hada- 
mard matrix of order 92 was recently constructed by L. D, Baumert, 
and from it one of order 184 can be constructed also, 
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the generator matrix for the iteration of two codes is combina- 
torially equivalent to the tensor product of the generator matrices 
of the two original codes. 

It should be noted that certain symbols, such as those in the 
lower right-hand corners in Figure 5.2, are checks on check 
symbols. These can be filled in as checks on rows and will be 
consistent as checks on columns, or vice versa. If they are filled 
in as checks on rows according to the parity-check rules for the 
row code, then each parity-check column is actually a linear com- 
bination of the columns that contain information symbols. Each of 
these has parity symbols added to it to make it a code vector, and 
therefore the parity-check columns, being linear combinations of 
code vectors for the column code, are also code vectors for the 
column code. 

Two observations can be made about error-correcting ability 
for these codes: 


Theorem 5.3, The minimum weight for the iteration, or 
product, of two codes is the product of the minimum weights 
for the codes. 


Proof: If one code has minimum weight w; andthe other w2 , 
a vector in the product code must have at least w; nonzero ele- 
ments in each row that contains a nonzero element and at least w2 
nonzero elements in each column that contains a nonzero element, 
and therefore has wy, wz nonzero elements if it has any at all. 
Also at least one such pattern is possible if the first code has a 


vector of weight w; and the second a vector of weight wz . 
QED 


Theorem 5.4. For a binary symmetric channel, if one code 
has probability of error f,;(P) and another f,(P), their 
product is capable of decoding with probability of error no 
greater than fz [f,(P)] . 


Proof: Suppose that the first code applies to rows, and that after 
all the information is received the decoding is done on rows alone. 
Then the probability of an error inany row is f,(P) , and there- 
fore the probability that any particular symbol is in error is no 
greater than this. Also, the rows are independent, and, since 
each column contains only one symbol from each row, the sym- 
bols in each column are independent, Then the columns are de- 
coded using the column code, and the resulting probability of error 
is no greater than f,[f,(P)] . There might, of course, be a better 


way to decode. 
QED 


Elias used these ideas in an interesting way to find for the binary 
symmetric channel, a sequence of codes whose probabilities of 
error approach 0, and whose rates approach a limit greater than 
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0 as the length of the codes approaches infinity. This is the only 
known example of a coding system with both these properties. 

The system uses the Hamming single-error-correcting, double- 
error-detecting code. This code has n= 2™ symbols, of which 
m +1 are parity-check symbols and 2™ - m - 1 are information 
symbols. (See Section 5.1.) It is capable of correcting single 
errors, All combinations of an even number of errors are detected 
and no change is made in the received vector. However, if the 
number of errors is odd and at least three, the correction pro- 
cedure will be applied, and one symbol that probably was correct 
will be changed, thus introducing an extra error. The probability 
for a particular pattern of i errors is Pign-i ; there are 
such patterns, and therefore the probability that i errors will 


occur is P(i) = (Pat st” Tine average number of errors ex- 
pected per block, then, is 


n n-1l 
nP; s >» iP(i) + ) (i + 1) P(i) 
even i22 odd i23 
n 
= 2(5) a ee : 
is3 
n 
(i+ 1)( : : 
=2(5)P? Jo *s ” soba a ie 
2P? ( oe 
n 
a ny 2 n-2 i+l1 n-2, i- 2 n<i 
=2(_)P a 
(3) . . pe thew) peas Q 
i=3 


lA 
Ny 
— 
N 5 
“— 
‘J 
N 
1e) 
3 
' 
NS) 
K4 5 
ws 
» Bp 
NN 
“— 
‘Ud 
3 
N 
re) 
5 
%, 


= 2(3)P? =e n(n - 1) P? 


and therefore, the probability that an error will remain in any 
symbol after correction is 
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P; $ (n- 1) P? < nP’ (5. 10) 


Now consider iterating these codes r times, starting with 


n = 2™ and doubling the length of the code introduced at each stage, 


so that the code used at the jth stage has length amti-l | Let 


P,)=P denote the channel probability of error and Pj; the proba- 
bility of error after i iterations. Then by Equation 5.10, 
m+ti-1 


Panes Pp? 


i) (51) 
i i- 


and repeated use of Equation 5.11 together with Equation 4.25 


yields 


r-2 r-3 ee al Yr 
mth gmreye rr yp? 


-l 
< (22 (2 


‘J 
A 


= = xe _ 
His 
tase at. Cakes (5, 12) 


and this approaches 0 as r approaches infinity as long as 
2™p, < 1/2 ,that is, if the expectednumber of errors per row 
in the first iteration is less than 1/2. 

Finally the fraction of the symbols that will be information sym- 
bols after r iterations can be estimated as follows: The number 
of parity-check symbols in the code used at the jth iteration is 
logg nt 1=m+i , so the fraction of information symbols is 


m +i 
“gati-l 
and at each stage check symbols are added, cutting down the over- 


all fraction of information symbols by this ratio. Therefore, the 
over-all rate is 


m.+ 1 m +2 mtr 
hall (abe een) at ae 
( 3m )( gmtl 2 


This can be bounded by use of the relation 


1 





(1. =a), (2. =sb)i> 1 -= Aa tb) if'5o2>0) and b>0O 


and this together with Equation 4. 25 yields 





m +1 m+t+2 mtr m+2 
r>1-(MtiyRie +... ee ate (5. 13) 
Soe: gmt gmtr-1 2 


In summary, then, if the channel probability of error is sufficient= 


ly small that the expected number of errors in each row of the first 
iteration is less than one-half, the probability of error can be made 
arbitrarily small by taking enough iterations, and still the rate, 

or fraction of symbols that carry information, is greater than a 
fixed constant for any number of iterations, 
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The rate for this code falls short of the rate known to be possible 
by Shannon's fundamental theorem for the noisy channel. In fact, 
the efficiency in this respect is limited in a sense by the efficiency 
of the first iteration. The probability of error (and efficiency) of 
the first iteration is limited for short codes by the sphere-packing 
bound, so that, in order to increase efficiency beyond a certain 
point, the length of the first iteration would have to be increased. 
(This notion of efficiency can be made precise. See Reference 86.) 
This may, however, be the fault only of the decoding method, and 
not of the code itself. 

Another important point is that the minimum weight after r 
iterations is 47 , since a code of minimum weight 4 is used in 
each iteration. The ratio of minimum weight to code length, 
ad _ p2r-mr-(r(r-1)/2) 


NE ph ae 





Pla 


fa (5, 14) 
La isee 
approaches 0 as r approaches infinity, and therefore falls short 
of what the Varsharmov-Gilbert bound shows is possible. In addi- 
tion, the decoding system described is not optimum, and so not 
even all the errors that Equation 5. 14 indicates could be cor- 
rected are corrected. The code succeeds by correcting the over - 
whelming majority of the likely error patterns, many of which con- 
sist of many more than d/2 errors. 


NOTES 


The Hamming codes were first described in Reference 58. Generalizations 
to the nonbinary case were made first by Golay, #7, °° and finally to the case 
where the symbols are taken from an arbitrary finite field by Cocke.”! See 
also References 106 and 123 and the material on Hamming codes in Chapter 8. 
The material on the weights of Hamming codes is to the best of my knowledge 
original. The Golay (23, 12) code is described in Reference 48 and as a 
cyclic code by Prange. 93 

Muller ®3 discovered the codes and Reed” the decoding scheme that bear 
their names. These codes have been discovered by Honda® ina different 
way, and still another description is given by Slepian. 195,10 The geometric 
treatment of Reed-Muller codes and others appears in a well-written and in- 
teresting report by Kautz. 66 Dwork and Heller?® have found a generaliza- 
tion beyond simply using a different field. 

The MacDonald codes appear in References 73 and 74. Codes derived 
from Hadamard matrices were first found by Plotkin, °° The connection 
with Hadamard matrices and symmetrical block designs was pointed out by 
Bose and Shrikhande,'*" The material on iterated codes was taken from 
Elias! work.*® Some additional material Appeara in References 17 and 86. 
Problem 5,3 i8 an extension of Slepian's Propoaition 5, 1°%» 16 

Mitani'# early discovery of the Reed=Muller codes" came to my attention 
after this book wae published, 
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PROBLEMS 


~5.1. Let H bean mXn matrix, gm-1 Sigs gm , whose columns are 
the binary representation of the column number. Show that for the code 
which is the null space of H , every coset contains a vector of weight 2 oF 
less. Show that the code corrects all single errors and is therefore quasi- 
perfect. (Hint: Use Problem 3.2.) 

-5,2. Show that the Hamming single-error-correcting sno Sacha 
detecting binary code is quasi-perfect if it is of length n = 2 and hes 
m +1 parity checks, but that if any column is dropped from the parity-check 
matrix there is a coset with minimum weight 33 


5.3. Show that there is a quasi-perfect single-error-correcting binary 


code with m_ parity-check symbols for an ngth n satisfying 
gm/2t+l _2<n<2™ if m is even, ene} 78S aim-1)/2 2<n<2™ if m 


is odd, (Hint: Include in the parity-check matrix all columns that have 0's 
in the upper half of the rows and all columns that have 0's in the lower half of 
the rows.) 
This result can be generalized directly to linear codes with q symbols. 
5,4, Devise a procedure for correcting double erasures for the Hamming 
distance-3 code. 


5.5, Devise a way of decoding in spite of 2m-r _ 1] erasures with the 
Reed-Muller codes. 

5. 6, Show that with the simple iterated code consisting of a parity check on 
rows and a parity check on columns it is possible to correct all combinations 
of three erasures, but there are combinations of four erasures which are 
uncorrectable. 





Chapter 6 


POLYNOMIAL RINGS AND GALOIS FIELDS 


The remainder of this book requires some knowledge of rings, 
ideals, residue classes, and the basic structure of finite fields. 
The purpose of this chapter is to present the minimum background 
necessary for understanding subsequent chapters. 


6.1. Ideals, Residue Classes, and the Residue Class Ring 


In the theory of groups, subgroups, particularly normal sub- 
groups, are very important. In the theory of rings, ideals play 
the corresponding role, An ideal I is a subset of elements of a 
ring R with the following two properties: (1) I is a subgroup of 
the additive group of R_ , and (2) for any element a of I and 
any element r of R_, ar and ra areinl. (This is sometimes 
called a two-sided ideal.) 


Example: In the ring of all positive and negative integers and 0, 
the set of all multiples of any particular integer is an ideal. 


Since an ideal is a subgroup,cosets can be formed, In this case 
the cosets are called residue classes. The ideal forms the first 
row of an array, with the 0 element at the left. Then any ring 
element not in the ideal can be chosen as leader of the first residue 
class, and the rest of the class is formed by adding the leader to 
each of the elements of the ideal: 


Oe. a2, a3, als as, 
Yy 2 Fp t-2ji4 Ty +ae, Hy 8g; ih tags bik k= Br A | 
Y2 =Y2 + a, T2 + a2, rz + a3, be i as Pa ae» 


The first element in each row is, as before, a previously unused 
element, 

Of course, all properties of cosets apply to residue classes 
also. In particular, since addition, the group operation, is com- 
mutative, an ideal is a normal subgroup and addition of cosets is 
defined; 


{r} + (eo) = (r +o) 


“7 
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where {r} denotes the residue class containing r. With this 

definition the residue classes form a group under addition, the 

factor group discussed in Section 2.4. It is possible also to de- 
fine multiplication of residue classes: 


{r}{s} = {rs} (6. 1) 


This is a valid definition only if, no matter which elements are 
chosen in the residue classes that are being multiplied, Equation 
6.1 defines the same residue class as the product. That is, if r 
and r' are in the same residue class andif s and s' are in the 
same residue class, then rs andr's' must be in the same 
residue class, and this will be the case if and only if r's' - rs 

is in the ideal: 


r's'-rse2er's'-r's+r's - rs =r'(s'-s) + (r'-r)s 
Since s'-s and r'-r are in the ideal, so is each term on the 
right side of this equation, andhence sois r's'-rs . There- 


fore this definition of multiplication of residue classes is con- 
sistent. 


It is easily verified that the associative and distributive laws 
hold: 


{a}{b}{c})= {a} foc} = fabc} = {ab} {c} = ({a} {b}Xe} 
{a} ({b} + {c}) = fa}{b+c} = {a(b+c)} = {ab} + {ac} = {a} {b} + fa} {c} 


and similarly for the other distributive law. Clearly multiplica- 
tion is defined for any pair of residue classes. Therefore: 


Theorem 6.1. The residue classes of a ring with respect to 
an ideal form a ring. 


This ring is called the residue class ring. 


Example: In the ring of all integers, consider the ideal that 
consists of all even integers. Then there will be 2 residue 
classes {0} and {1} . It is easily seen that the arithmetic 
in the residue class ring is exactly ''arithmetic modulo 2,"! 


6.2. Ideals and Residue Classes of Integers 


If r,s, and t are integers and rs =t , then it is said that 
t is divisible by r or that r divides t . Aninteger p that is 
divisible only by +p or +1 is called prime. The greatest 
common divisor of two integers is the greatest positive integer 
that divides both of them. Two integers are said to be relatively 
prime if their greatest common divisor is 1, 

If r divides s and s divides r , then either re2#s or 
r=-s , forif r divides s and s divides r , then for some a 
and b , r=2sa and s#rb , andtherefore r# rab , and ab 
must equal 1. Therefore a®b"' , and a and b must both be 
either +1 or -1. 
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For every pair of integers s and d there is a unique pair of 
integers q , the quotient, and r , the remainder, such that 


s Sidq-c xr where Osr<|da| (6. 2) 


This is known as the Euclidean division algorithm, and from it 


some very important algebraic properties of the integers can be 
proved, including the fact that every integer can be expressed 
uniquely as a product of powers of primes, and the fact that the 
greatest common divisor d of two integers r and s can always 
be expressed in the form 


d=ar+bs (6453) 


where a and b are integers. An illustration of how the greatest 
common divisor is found using the division algorithm will indicate 
the method of proof, The greatest common divisor d of 973 and 
301 is found as follows: 


973 = 3 x 301 + 70 
301 24x 70+ 21 
MOSS Belek 47 
BS 3X eT ate) 


Since d divides 973 and 301, it must divide the remainder 70. 
Since it divides 301 and 70, it divides 21. Since it divides 70 and 
21, it divides 7. On the other hand, 7 divides 21, therefore 70, 
therefore 301, and finally also 973, and therefore d must be 7. 

Now the above equations can be used to express 7 in the form of 
Equation 6. 3, for 


7 = 70 = 3X 21 

= 70 - 3X (301 - 4X 70) 

= -3X 301+ 13X70 

= -3 X 301 + 13 X (973 - 3 X 301) 
=.13* 973 = 42.% 301 


Theorem 6.2. A set of integers is an ideal if and only if it 
consists of all multiples of some integer. 


Proof: Let r be the smallest positive integer in an ideal and s 
be any other integer in the ideal. Then their greatest common 
divisor d is in the ideal, for by the definition of an ideal both 
terms on the right side of Equation 6.3 are in the ideal, and hence 
their sum is also, Since r is the smallest positive integer in 
the ideal, rd. Since d divides r , dSr . Therefore 
red, andr divides s and hence divides every integer in the 
ideal, Finally, every multiple of r is in the ideal, by the defini- 
tion of an ideal, QED 
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An ideal that consists of all multiples of one ring element is 
called a principal ideal, and a ring in which every ideal is a prin- 
cipal ideal is called a principal ideal ring. Theorem 6.2 states 
that the ring of integers is a principal ideal ring. 

The ideal that consists of all multiples of m is denoted (m) 

The residue class ring formed of residue classes of (m) is called 
the ring of integers modulo m . 


Theorem 6.3. Every residue class modulo m contains either 
0 or a positive integer less than m Zero is an element of 
the ideal, and each positive integer less than m is ina dis- 
tinct residue class. 


Proof: If s is any element of a residue class, then since 
s=mqtr 


r is in the same residue class, and 0Sr<m Tf, xe and) 6) ave 
in the same residue class, r- s is an element of the ideal and 
hence a multiple of m. If r#s, clearly they could not both be 
less than m and nonnegative. 


QED 


It follows from Theorem 6.3 that the list {0}, {1}, {2},..., 
{m - 1} includes each residue class once and only once. Com- 
monly the residue classes are named 0, 1, 2,..., m-1. This 
notation will be used in this book, since it should be clear from 
the context whether integers or residue classes are meant. 


Theorem 6.4, The residue class ring modulo m is a field if 
and only if m is a prime number. 


Proof: If m is not prime, then m=rs for some integers r 
and s that are not multiples of m Then {r}{s} = {m}=0 , 
andif {r} hadaninverse {r}7! , then {r}7!{r}{s} = {s} = 
{r}7! 0 =0 , which is a contradiction. Therefore {r} can have 
no inverse, and the residue class ring is not a field. 

It remains only to show that if m is prime, every residue class 
except 0 (the ideal) has an inverse. Every such residue class con- - 
tains aninteger s that is less than m andis not 0. Since 1 is 
its own inverse, it may be assumed that s >1. Then since m is 
assumed prime, the greatest common divisor of s and m must 
be either m or 1. Since m>s and therefore cannot divide s 
the greatest common divisor is 1. By Equation 6. 3, 


1 =am + bs 


and therefore {b}{s} = {1} , andthe residue class {s} has {b} 
as its inverse, 


QED 


These fields are called prime fields, or Galois fields of Pp 
elements, GF(p) , 
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6.3. Polynomial Ideals and Residue Classes 


Now consider polynomials f(X) , with one indeterminant (or 
variable) X and with coefficients from any field F 


ict) si, + hee va +... eb 


The degree of a polynomial is the largest power of X ina term with 
a nonzero coefficient. The degree of the 0 polynomial is 0. A 
polynomial is called monic if the coefficient of the highest power of 
X is 1. Polynomials can be added and multiplied in the usual way, 
and they form a ring. 

If r(X) , s(X) , and t(X) are polynomials and r(X) s(X) = t(X), 
then it is said that t(X) is divisible by r(X) or that r(X) divides 
t(X) , and that r(X) is a factor of t(X) A polynomial p(X) of 
degree n which is not divisible by any polynomial of degree less 
than n but greater than 0 is called irreducible. The greatest 
common divisor of two polynomials is the monic polynomial of 
greatest degree which divides both of them. Two polynomials are 
said to be relatively prime if their greatest common divisor is l, 

The degree of the product of two polynomials is the sum of their 
degrees. A polynomial of degree 0 is a field element and therefore 
has an inverse, but no polynomial of higher degree has an inverse. 
If r(X) divides s(X) and s(X) divides r(X) , they differ at most 
by a factor that is a field element. This can be shown in the follow- 
ing way. For some a(X) and b(X) , r(X) = s(X)a(X) and 
s(X) = r(X)b(X) Then, since the degree of r(X) equals the sum 
of degrees of s(X) and a(X) , the degree of r(X) is equal to or 
greater than the degree of s(X) Similarly, the degree of s(X) 
is equal to or greater than the degree of r(X) , and thus their 
degrees must be equal. Therefore a(X) and b(X) have degree 0 
and must be field elements. 

For every pair of polynomials s(X) and d(X) , there is a unique 
pair of polynomials q(X) , the quotient, and r(X) , the remainder, 
such that 


s(X) = d(X)q(X) + r(X) (6. 4) 


and the degree of r(X) is less than the degree of d(X) . This is 
the Euclidean division algorithm, and q(X) and r(X) can be ob- 
tained by ordinary long division of polynomials. 

Several important results are obtained by assuming a first- 
degree divisor x - a inthe division algorithm: 


£(X) = (X - a)q(X) +37 (6. 5) 


Since r must have degree less than the degree of the divisor, it 
must have degree 0; that is, it must be a field element. Sub- 
stitution of a for X then shows that r ® f(a) This is the 
remainder theorem, Then if f(a) # 0, thatis, a is a root of 
{(X) , then r#0 , and x =a ia a factor of f£(X) This result 
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is known as the factor theorem. Thus for each distinct root of 
f(X) there is a distinct first-degree factor. Since the degree of 
a product of polynomials is the sum of the degrees of the factors, 


the degree of f(X) is at least as great as the number of roots of 
{(X). 


~~ The parallel between the ring of integers and rings of polynomials 
over a field must be apparent. Both are special cases of an alge- 
braic structure called a Euclidean ring. The remainder of this 
section and the next two sections consist largely of the analogs of 
theorems in Section 6.2. Proofs will not be given, but the reader 
can construct them from proofs in Section 6.2 by changing the 
word "integer" to "polynomial" and the phrase "fa is less than b'' 
to ''the degree of a(X) is less than the degree of b(X)'' anda 
few very minor additional changes. 

The greatest common divisor d(X) of two polynomials r(X) 
and s(X) can always be expressed in the form 


d(X) = a(X)r(X) + b(X)s(X) (6. 6) 


where a(X) and b(X) are polynomials. This can be accomplished 
by use of the division algorithm in a manner exactly analogous « 
to the method used for integers. 


Theorem 6.5. A set of polynomials is an ideal if and only if 
it consists of all multiples of some polynomial. 


That is, the ring of polynomials is a principal ideal ring. The 
ideal which consists of all multiples of f(X) is denoted (f(X)). 
The residue class ring formed from this ideal is called the ring of 
polynomials modulo f(X) 


Theorem 6.6. Every residue class modulo a polynomial f(X) 
of degree n contains either 0 or a polynomial of degree less 
than n . Zerois ‘an element of the ideal, and every poly- 
nomial of degree less than n is ina distinct residue class. 


6.4. The Algebra of Polynomial Residue Classes 


Theorem 6.7. The residue classes of polynomials modulo a 
polynomial f(X) of degree n form a commutative linear al- 
gebra of dimension n over the coefficient field. 


Proof: Scalar multiplication is defined by the equation a{r(X)} = 
far (X)} , and it is easily verified that all the axioms are satisfied 
for a vector space and algebra. For example, the distributive law 
is verified as follows: 


{r(X)}({s(X)} + {t(X)}) 


{r(X)(s(X) + t(X))} = {r(X)s(X) + r(X)t(X)} 
{r(X)} {9(X)} + {r(X)} (t(X)} 


That it has dimension n can be seen from the fact that the n 
residue classes {1} , {X}, {X*},..., {(X"°") span the 





rings and fields F3 


space, since every residue class contains a polynomial of degree 
less than n , and 

n-1 
x" } (6. 7) 


-l 
{ag + ayX+...+a, x: } =ao{1} + a, {x} toeet ay 


=i -1 


Also, these n residue classes are linearly independent, for the 
right-hand side of Equation 6.7 is an arbitrary linear combination 
Ofe tale kaye. clas {x"-1} and the left side is 0 only if 
agit ayer tails pxned is divisible by f(X) , which is impossi- 
ble, or if all the a; are 0. 

QED 


It is quite common to use the polynomial of minimum degree in 
a residue class to represent that residue class, but here using the 
same notation for both may lead to some confusion. In this book, 
whenever the brace notation for residue classes is not used, the 
following system will be used. Some symbol, typically S or a, 
will be used to represent the residue class containing X . The 
residue class containing a field element will be given the same 
name as the field element — this should not cause confusion, Then 
the coset that contains ap +a;X +... + ay_ x7" is 


PROSE ite ce ree Aa tt ee 


ww 


fan tayX +... + anf 


=fagith ayiG +) 6. + acbagent 


Thus every residue class equals a polynomial of degree less than 
n in S 


Theorem 6.8. In the algebra of polynomials modulo a poly- 
nomial f(X) of degree n , f(S) =0 , but no polynomial in 
S of degree less than n is 0. 


Proof: 


MEA bane te 
fo+ fj {X} +... +£,4"} 
=f) +X +... +£,X™} = {£(X)} = 0 


Similarly, if g(X) is any polynomial of degree less than n, 
g(S) = {g(X)} , and by Theorem 6. 6 this is not the ideal. 


£(S) 


QED 


It follows from this theorem that every polynomial in S of 
degree less than n is a distinct residue class, for otherwise their 
difference would be a polynomial of degree less than n in S 
equal to 0, 


Theorem 6.9. Let I be an ideal in the algebra of polynomials 
modulo {(X) and let g(X) be a nonsero polynomial of 
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smallest degree such that the residue class {g(X)} is in I 
Then {s(X)} is in I if and only if s(X) is divisible by g(X). 
Furthermore, g(X) divides f(X) 


Proof: By the division algorithm, 
s(X) = g(X)q(X) + r(X) 
where r(X) has degree less than the degree of g(X) . Therefore, 


{s(X)} = {g(X)} {a(X)} + {r(x} 


and if {s(X)} and {g(X)} arein I , sois {s(X)} - {g(X)} {q(X)} = 
{r(X)} . Since r(X) has degree less than the degree of g(X) and 
g(X) was assumed to be a nonzero polynomial of smallest degree 
such that {g(X)} isin I , r(X) must equal 0. Therefore, s(X) 
is a multiple of g(X) . Conversely, if s(X) is a multiple of g(X), 
then s(X) = g(X)q(X) and {s(X)} = {g(X)} {q(X)} , andif {g(X)} 
isin I , {s(X)} must be in I also. 

By the division algorithm, 


£(X) = g(X)q(X) + r(X) , 
where r(X) has degree less than the degree of g(X) . Then 
{0} = €€(X)} = f(X)} (a(x) + f(x) 


andso {r(X)} isin I . Since r(X) has degree less than the 
degree of g(X), r(X) mustbe 0, and f(X) is a multiple of g(X) . 
QED 


Theorem 6,10. For every ideal I in the algebra of poly- 
nomials modulo f(X) there is a unique monic polynomial 
g(X) of minimum degree such that {g(X)} is in I . Con- 
versely, every monic polynomial g(X) that divides f(X) 
generates an ideal I in which g(X) is the monic polynomial 
of minimum degree such that {g(X)} is in I 


Proof: There must be a polynomial h(X) =h) th)X +... +h,.X” 


of minimum degree such that {h(X)} isin I. Then hy~*h(X) 
is a monic polynomial of minimum degree whose residue class is 
also in I, and therefore there exists at least one monic poly- 
nomial of minimum degree inI. If there are two, g(X) and 
g'(X) , then, by Theorem 6.9, g(X) divides g'(X) and g'(X) 
divides g(X) , and so they differ at most by a factor that is a 
field element, Since both are assumed monic, the field element 
must be 1, and g(X) = g'(X) . Thus there is a unique minimum 
degree monic polynomial g(X) such that {g(X)} isin I. 

Now assume that g(X) is a monic polynomial that divides f(X) 
and consider the ideal I generated by {g(X)} , that is, the ideal 
consisting of all multiples of {g(X)} . Suppose that {r(X)} is 
in I. Then 


fr(X)} = OX) OX) © (eOX)acxX)) 
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for some a(X) , and therefore 
r(X) = g(X)a(X) + £(X)b(X) 


for some b(X) . Since f(X) is a multiple of g(X) , r(X) is 
also, and therefore if it is not 0 it has degree at least as great as 
the degree of g(X) . Thus g(X) is a monic polynomial of mini- 
mum degree such that {g(X)} isin I. 

QED 


Theorem 6.11, Let f(X) = g(X)h(X) where f(X) has degree 
n and h(X) has degree k . Then the ideal generated by 
{g(X)} in the algebra of polynomials modulo f(X) has 
dimension k 


Proof: In the ideal, which is a subspace, the vectors {g(X)} , 
(pie )tge.as Eo 1g(X)} are linearly independent, for any linear 
combination of them is of the form {fag+... + ay Leer 1) g(x) } and 
thus cannot be 0 by Theorem 6.6, since the residue class contains 
a polynomial of degree less than n . Furthermore, if {s(X)} is 
in the ideal, then s(X) is divisible by g(X) by Theorem 6.9, and 
if s(X) is the polynomial of minimum degree in the residue class, 
it has degree less than n . Thus 


5(X) = g(X)q(X) = g(X)(qo + aX +... + ae pXk 
and 


{8(X)} = go{g(X)} + a Ke(X)} +... tay, (XK-1g(x)} 


and the k vectors {g(X)} , {Xg(X)} ,..., {xk-1g¢x)} span the 
ideal, Therefore, the dimension of the ideal is k 
QED 


The monic polynomial g(X) of minimum degree such that {g(X)} 
is in an ideal I is called the generator of the ideal. 

Theorems 6.9 to 6.11 can be summarized as follows: Every 
ideal in the algebra of polynomials modulo f(X) has a generator 
polynomial g(X) that divides f(X) , and every monic polynomial 
that divides f(X) generates a different ideal. Every residue class 
in the ideal generated by g(X) contains a unique polynomial that 
is divisible by g(X) and has degree less than the degree of f(X) , 
and every such polynomial is in a residue class that is in the ideal. 

There is a natural correspondence between n-tuples and poly- 
nomials in the algebra of polynomials modulo f(X) of degree n. 
The n-tuple ag, a ,..., ane] corresponds to the polynomial 
ataySt+... + a4.y8"-* . The sum of two n-tuples corresponds 
to the sum of the corresponding polynomials, and multiplication 
by scalars carries over similarly, In subsequent chapters the 
n-tuple a), @) »+++» @nwy and the polynomial ap +a,;S +... + 
a,.18"" will be considered to be only different ways of representing 
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the same element of the algebra, and whichever notation is more 
convenient will be used. Similarly, an element of the algebra will 
sometimes be called a vector, sometimes a polynomial. 

A polynomial r(S) will be said to be in the null space of an ideal 
I if r(S)s(S) = 0 for every polynomial s(S) in I . This definition 
differs from the definition given in Chapter 2 for a null space be- 
cause the requirements that the inner product of vectors be 0 and 
that the product of polynomials be 0 are not the same. There is, 
however, a very close connection if f(X) =X" -1 . Let 


a(S) =a +ta,S +... + 8.008550 


b(S) = by +b, S +... +b,. 87? 
Then the coefficient of SJ in c(S) = a(S)b(S) is 


= AY A : ‘ ate Be 
ag ge + a, Past + + a + ia and + at + ae] jt] 
(6. 8) 
The terms involving ajp]r+++> Any Come from terms in the prod- 


uct a(S)b(S) which involve S"+j , but, since S®-1=0, S®'N=S)J . 
This can be rewritten as dot, or inner product: 


Se BBG. a) Tobe eb ag Deved 


were elena. fers b rey 
J are | j j-1 & 


pe) n= 2” 


ja? 
The first vector is the vector corresponding to a(S) . The second 
is a vector consisting of the coefficients of b(S) in reverse order 
and shifted cyclically j +1 units to the right. Thus if a(S)b(S) is 

0, then the vector corresponding to a(S) is orthogonal to the 
vector corresponding to b(S) , with the order of its components 
reversed, and to every cyclic shift of this vector. The converse 

is also true: if (ag,..., a,.,) is orthogonal to (b,_],--., bo) 
and to every cyclic shift of this vector, then a(S)b(S)=0 . 








Theorem 6.12. Let f(X) , g(X), and h(X) be monic poly- 
nomials, and let f(X) = g(X)h(X) . Then {a(X)} is in the null 
space of the ideal generated by h(X) if and only if it is in the 
ideal generated by g(X) 


Proof: If {a(X)} is in the ideal generated by g(X) and {b(X)} 
is any residue class in the ideal generated by h(X), then a(X) is 
a multiple of g(X) and b(X) is a multiple of h(X) , and a(X)b(X) 
is a multiple of f(X) . Therefore, {a(X)} {b(X)} = {a(X)b(X)} =0, 
and this {a(X)} is in the null space of the ideal generated by h(X). 
Conversely, if {a(X)}{h(X)} =0 , then a(X)h(X) must be a mul- 
tiple of f(X) . It follows that a(X) must be divisible by g(X) , 
and therefore {a(X)} is in the ideal generated by g(X) 

QED 


Examples of the use of these ideas appear in Section 8, 1 and 
8,2. 
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6.5. Galois Fields 


Theorem 6.13, Let p(X) be a polynomial with coefficients 
ina field F . If p(X) is irreducible in F , that is, if 
p(X) has no factors with coefficients in F , then the algebra 
of polynomials over F modulo p(X) is a field. 


The proof is exactly analogous to the proof of Theorem 6. 4. 


Example: Consider the ring of polynomials with real-number 
coefficients modulo the irreducible polynomial X* + 1= p(X). 
Denote the residue class that contains X , {xX} =i . Then 
every element of the resulting field can be expressed as a poly- 
nomial of degree less than 2 in i , that is, in the form a+bi. 
Since i satisfies the equation p(X) =0 , by Theorem 6.8, 

i? +120 , or it #-1 . This is merely one way of describing 
the field of complex numbers. 


The field formed by taking polynomials over a field F modulo 
an irreducible polynomial p(X) of degree k is called an extension 
field of degree _k over F . If the residue class containing X 
is called a , the extension field is denoted Fla] . The original 
field F is called the ground field. The new field contains an 
element (a residue class) corresponding to each element in the 
ground field, and it is said that it contains the ground field. Siuce 
p(a) = 0 , a is a root of p(X), andit is said that the extension 
field is obtained by adjoining a root of p(X) to the ground field. This 
language is suggestive and convenient, but it should be thought of 
as a heuristic description of the process of forming a field in 
which the elements are residue classes. 

In Section 6, 2 it was shown that residue classes of integers 
modulo any prime number p form a field of p elements called 
the Galois field GF(p) . It can be shown that the ring of poly- 
nomials over any finite field has at least one irreducible poly- 
nomial of every degree. The field of polynomials over GF(p) 
modulo an irreducible polynomial of degree m is called the 
Galois field of p™ elements, or GF(p™) . It is, by Theorem 
6.7, a vector space of dimension m over GF(p) and hence has 
p'™ elements. For any number q=p™ that is a power ofa 
prime number, therefore, there is a field, GF(q) , whichhas q 
elements. It can be shown also that every finite field is isomorphic 
to some Galois field; that is, every finite field has the same 
structure as some Galois field and differs only in the way the ele- 
ments are named. It can also be shown that any two finite fields 
with the same number of elements are isomorphic; that is, they 
differ only in the way the elements are named. 

The Galois fields that can be realized by taking residue classes 
of polynomials modulo an irreducible polynomial over GF(p) are 
said to be fields of characteristic p . Thus GF(p™) is a field 





98 error-correcting codes 


of characteristic p for any choice of m . Inthe field GF(p) , 
p= 0. Since this is the coefficient field for GF(p™) , it is true 
for all fields of characteristic p that p=0O . Then 


(at pyP = aP+(P)aP ty 4 (BY aP “ne es 


and all the binomial coefficients (P for 0 <i<p have p asa 
factor and therefore are 0, so that the following theorem is valid: 


Theorem 6.14. Ina field of characteristic p , (at 5) ee 
aP + bP 


Now consider a ground field F and an extension field, and let 
6B be any element of the extension field. The monic polynomial 
m(X) of smallest degree with coefficients in the ground field F 
such that m(§) = 0 is called the minimum polynomial or minimum 
function of B 


Theorem 6.15. The minimum function m(X) of any element 
8 is irreducible. 


Proof: Suppose that on the contrary m(X) = m,(X)m2(X) . Then 
m(8) = m,(8) + m2(f) , and at least one of the factors m,(f) or 
m2(B) must be 0. If these are nontrivial factors, the hypothesis 


that m(X) is the minimum degree polynomial is contradicted. 
QED 


Theorem 6.16. If f(X) is a polynomial with coefficients in 
the ground field F andif f£(6) =0 , then f(X) is divisible 
by m(X) , the minimum function of 6 . 


Proof: By the Euclidean algorithm, 
£(X) = m(X)q(X) + r(X) 


where r(X) has degree less than the degree of m(X) . Since 
f(8) =O and m(®)=0 , r(B)=0 . Since m(X) is the minimum 
function of B and r(X) has degree less than that of m(X) , 
r(8) =O only if r(X) =0 

QED 


It follows from Theorem 6. 16 that the minimum function of B 
is unique. It follows also that if p(X) is a monic irreducible poly- 
nomial and p(®) =0 , then p(X) is the minimum function of 6 . 


Theorem 6.17. Every element of an extension field of degree 
k over F has a minimum function of degree k or less. 


Proof: By Theorem 6.7, the extension field is a vector space 
of dimension k . Therefore for any element ff , the k +1 ele- 
ments, 1... dhe oes pk cannot be linearly independent, Con- 
sequently there must be some polynomial of degree k or less in 
Bp which is equal to 0, and this polynomial can be made monic by 


dividing it by ite leading coefficient, QED 
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6.6. The Multiplicative Group of a Galois Field 


Consider in any finite group the set of elements formed by any 
element g and all its powers gg = g A gg = g?, andsoon. There 
can be at most a finite set of such elements, and therefore at some 
point there must be repetition; that is gis gd for some i and j 
Then, multiplying by (gi)-) =(g-1)i gives 1=g)-1 . Therefore 
some power of g equals 1. Let e be the smallest positive in- 
teger such that g® = 1. Then e is called the order of the element 
g . The set of elements 1, g, 3” 52.0, BoAr* forma subgroup, 
for the product of two such elements is another of the same form, 
and the inverse of gJ is ge-j and hence is one of the elements of 
this set. A group that consists of all the powers of one of its ele- 
ments is calleda cyclic group. 

The order e of any element g of a group divides the order of 
the group, for the group consists of the cyclic subgroup of e ele- 
ments generated by g , anda number of cosets of this subgroup, 
each of which has e elements also. 


Theorem 6.18. The polynomial x91 _ 1 has as roots all the 
q- 1 nonzero elements of GF(q) 


Proof: The set of q- 1 nonzero elements of GF(q) forms a 


group. The order of each element of GF(q) must divide q-1 , 
and therefore each of the q - 1 elements is a root of the polynomial 


xd-l.1 . But this polynomial has at most q- 1 roots, since 
it is of degree q-1 , and therefore these must be all of the roots. 
QED 


Theorem 6.19. The polynomial x. 2 divides X*~4 if 
and only if m divides n 


Proof: Suppose that n=md . Then Y-1 divides Y?-1 , 
since Y=1 isarootof Y¢-1.. Substituting X™ = Y then 
shows that X™ - 1 divides xmd _ 1 

Now suppose that n=mdtr , where r<d. Then 


d 


ota + x ~ 1 


and, by the division algorithm, 


d 
x" - 1 = q(X)(X° - 1) + r(X) 
Comparison of these equations shows that 


r,.,.md 
q(X) ee and r(X) =X - 1 


ge )d 
since the former is a polynomial and the latter has degree less 


than d ,. Then the remainder is 0 only if r #0, thatis, if m 
i : 
divides n QED 
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Theorem 6.20. In GF(q) there is a primitive element a , 
that is, an element of order q - 1 
of GF(q) can be expressed as a power of a ; that is, the 
multiplicative group of GF(q) is cyclic. 


Every nonzero element 


The proof of this theorem will be omitted. Proofs can be found 
in References 5 (page 124) and 18, for example. The validity of 
the theorem can be seen in a crude way from the following con- 
siderations. An element of order e must bea root of X©-1 , 
and since e must divide q-1 , X®&-1 must divide X97 *-1 
But there are simply not enough factors of x49-1_ 1 of the form 
X© - 1 with e <q- 1 to account for all the q - 1 nonzero field 
elements. Therefore there must be some field element a that is 
a root of X4-1! - 1 but not of any polynomial X° - 1 for e<q-1, 
and consequently the order of a must be q - l Then the q - l 
distinct field elements a, ae bee er ad-l =] allare roots of 
x4-1-1 , so that they must be all the nonzero field elements. 


Example: The Galois field of 2* elements GF(2‘) may be formed 
as the field of polynomials over GF(2) modulo X*+X +1 

Let a denote the residue class that contains X Then a isa 
root of X* +X +1 , and this happens to be a primitive element 
of the field. Then the 15 nonzero field elements are as given in 
Table 6.1. 


Table 6.1. Representation of GF(2*) 


a® =1 = (100 0) 
a « a = (0 10 0) 
a’ = a’ = (0010) 
as a? =(0001) 
a*=lta =" 150!,0) 
a” = a +a’ = (0°11 0) 
a® = a” +a? =010. 123) 
eee eats +a? =(1101) 
a® =] +a? = (1.0 1.0) 
a’ s a ta? =(0101) 
a= 1+a +a? =(1 110) 


= a +a? +a? =(0111) 


Mel¢atae +a? 2(1 111) 
aids ] +a* +a) #(101 1) 
alte] 4 +a? =(100 1) 
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The following seven theorems give further details on the re- 
lationships between the multiplicative properties of field elements, 
the minimum polynomials of field elements, and the polynomial 
X4-X . Following these theorems is an illustration of their ap- 
plication to the factorization of polynomials of the form X™-1 , 
which should enable the reader to gain further insight into the 
structure of the field. 


Theorem 6.21. If f(X) is a polynomial with coefficients in 
GF(q) and £§ is a root of f(X) in an extension field of GF(q) , 
then 649 is also a root of f(X) 


Proof: Let f(X) = ag ta,;X+... + a,x” ., /Then 
n 
(£(X))7 = (ap) + (ay X)4 +... + (a,x)? 
= agt + ayxd Oa. hae Uke aux" 


by Theorem 6.14. Then by Theorem 6. 18, girls 1 , and there- 
fore ad =a for any element a of GF (q) Therefore (f(X))¢ = 
ag ta;yXI+... + a,(X%)" = (X49), and, if £(8) =O , then 
(£(8))4 = £(8%) = 0 

QED 


Theorem 6. 22. Consider an extension field of GF(q) which 
contains all the roots of XZ - X Then all these roots 
form a subfield. 


Proof: By Theorem 6, 14, if a and b are two roots, 

(a + b)@ = ad™ + pq™ =a+t+b_,andso a+b isa root of 
XS Also (-a)%™ = -(a4 )=-a , andso -a isa root if 
a is. (Note that -a =a if the characteristic of the fieldis 2.) 
Therefore the roots form a group under addition. If a and b 
are roots, ab is a root, and a~! is also (ifa #0). The other 
axioms are satisfied by virtue of the fact that the roots belong to 
a field, 

QED 


Theorem 6.23. Every polynomial p(X) of degree m irreduci- 
ble over GF(q) is a factor of XV" -xX 


Proof; If p(X) =X , the theorem is obviously true. If p(X) #X, 
let a (which is not 0) be a root of p(X) in the extension field of 
polynomials modulo p(X) over GF(q) This is a field of q™ 
elements, and the set of all nonzero elements form a group of 
order qg™ - ] Therefore ithe order of a must divide q™-1 , 
and a must be a root of XT “4. ] Then by Theorem 6, 16, 
p(X) divides XV™=1 - 4, 

QED 
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Theorem 6.24, Every factor of xa" - X irreducible over 
GF(q) has degree m or less. 


Proof; Assume that p(X) of degree k is an irreducible factor of 
xg - X over GF(q) , and consider the extension field of poly- 


nomials over GF(q) modulo p(X) . Ithas q~ elements, each of 
which can be expressed in the form ap + ajat+...+a,_ya =f, 
where a isa root of p(X) and aj, a, ,... a,_y are elements 


of GF(q) . Then by Theorem 6. 14, 


m m TH. om. m lle 1) 
pt = aot Ss Cie at fn Ee uce 


m m 
By Theorem 6.18, a4 -!=1 , andhence a2 =a forany a in 
GRig))i and since’ anh, f agai. 9 a,_; are in GF(q) and there- 
fore also in the extension field GF(q™) , 


m m 
q q teat 
6 =a ota,a cae io ae 
Buta Wsia, root.of Xo  4- X., andrso A =a, and aJ =aqJ 
for all j . Therefore, 
m 
pt Faptaat... ta, ja” =68, and 6 is 


a root of gam X also. Since there are 2 de ch elements, 
while X@ -X has no more than q™ roots, q@2qk , and 
hence mZk 

QED 


Theorem 6,25, If 8B is an element of an extension field of 
GF(q) , then the order e of 6 divides qk - 1 but no 
smaller number of the form q™®-1 , where k is the degree 
of its minimum function. 


Proof: Let m(X) be the minimum pagers i of B , and assume 
its degree is k . Then m(X) divides X4-* -1 , by Theorem 
6.23, and B is a root of X4*%-l1-1 . Therefore the order of B 
divides qk - 1. Suppose that the order of 6 divides q*- 1 for 
mek), s ‘Then Pvisea root.on ‘er oe , and m(X) is a factor of 
xis 3 by Theorem 6.16. Then the degree of m(X) is equal 
to or less than n , by 6. 24, 

QED 


Theorem 6.26. Let p(X) be a polynomial of degree m with 
coefficients in GF(q) , which is irreducible in this field, and 
let B be a root of p(X) in an extension field, Then 6 , 
Bova pam are all the roots of p(X) . 
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Proof: By Theorem 6.21, 6B, £B¢,. ys ids are roots of 
pie.” . The following argument shows that these m field elements 
are distinct. Suppose that they are not, and eq = aw , and suppose 
that 3°< 1" 4) ¢ then 


Thus the order of £ divides gris - 1. But p(X) differs from 


the minimum polynomial of B by at most a constant factor, and 
mt+j-i<m , the degree of p(X) mf _ his contradicts Theorem 
6.25, and therefore 6, B,..., gv are distinct. Since p(X) 
can have at most m roots, these must be all the roots. 

QED 


Theorem 6.27. All the roots of an irreducible polynomial 
have the same order. 


Proof: By Theorem 6.26, if 8 is one root, every other root 
can be n be expressed in the form py for some j . Let e denote 
the order of 6 and e! the order of pd . Then 


j j j j 
e e e 

(p7)° = pot = (pe) 217 = 1 

and therefore e' divides e . Similarly 
m jjm-j j m-j m-j 

e! a! e! e! 

pei dee Speke LY weds ed 
and therefore e divides e!. Since they are both positive inte- 
gers, e'=e 


QED 


The order of the roots of an irreducible polynomial is called the 
exponent to which that polynomial belongs. If an irreducible poly- 
nomial belongs to e , then it divides X© - 1 but no polynomial 
of the form X™-1 for n<e . Anirreducible polynomial of 
degree mover GF(q) is called primitive if it has a primitive 
element of GF(q™) as aroot. Then this root and hence all roots 
have order q™- 1 , and they are all primitive, by Theorem 6. 27. 
An irreducible polynomial of degree m is primitive if and only if 
it belongs to q™-1 , Finally, an irreducible polynomial of 
degree m is primitive if and only if it divides X" - 1 forno n 
less than q™@-1 , 

The use of the previous theorems is illustrated by factorization 
of polynomials of the form X". 1 , and a thorough understanding 
of the following example will give the reader insight into the sig- 
nificance of the preceding theorems, 
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Example: Consider factorization over GF(2) of the polynomial 
Rtas . It factors completely in GF(2°) , since all its roots 
are the nonzero elements of Gmi(2°) , by Theorem 6.18. This 
indicates that X°3 - 1 has no repeated factors, because all its 
roots are distinct. Since 63 = 37x 7 , X®3-1 is divisible by 
isi woh oe Ah ol, SRP GS Ty by Teeorem 
6.19. However, X3-1 divides X? - 1 and xX” -1 , and 

X - 1 divides each of these factors also. Define 


pi(X) =X - 1 (degree 1) 

Ys (X) = Sa} (degree 2) 

by (X) at iacuree ¢) 

Y (X) = Sa (degree 6) 

p, (X) Sa (degree 12) 
gg (X) - RE (degtee 36) 


Then 


X°3 - 1 = hy (Xb 3(X)b7 (Xho (ther (XG 63(X) 


and each of the factors is a polynomial. 

The nonzero elements of GF(64) can all be written as powers 
of a primitive element a , which has order 63, by Theorem 
6.20. It is easily verified that the element 1 is a root of ;(X). 


The elements a2! and a® have order 3 and must satisfy 
u3(X) . The elements a’, @8, a?7, a36, at5, and a54 have 
order 7 and are therefore roots of ¥7(X) . The elements l, 


a’, alt, a2, a28, a35, af#, a4?, anda®® are roots of X? -1 ., 


The elements a’, al4, a8, a35, a4?, and a5® have order 9 and 
are roots of W4(X) , while the others are roots of ¥,;(X) and 
~,(X) . Similarly, the powers of a that are multiples of 3 but 
not of 7 or 9 are elements of order 21 and are therefore roots 
of Y,(X) . The roots of Y,,(X) all have order 63, and hence 
are primitive. These polynomials j(X) are called cyclotomic 
polynomials, and factoring can be carried as far as this over 
any field, 

By Theorem 6.25, elements of order 3 should have minimum 
polynomials of degree 2, This result checks, Roots of order 7 
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should have minimum functions of degree 3, and therefore 

~7(X) must be the product of 2 cubic polynomials. Since by 
Theorem 6.25, the others must all have degree 6, W(X) is 
irreducible and belongs to 9, wW2,(X) has 2 irreducible factors 
that belong to 21, and eg has 6 irreducible factors that belong 
to 63 and are therefore primitive. 


This much can be said without even looking at the polynomials 
themselves. The factoring can be completed by direct compu- 
tation. Alternatively, for small polynomials over GF(2), the 
factoring can be completed by using Marsh's tables or the tables 
in Appendix C. 


NOTES 


Material in the first part of this chapter can be found in any of the books 
on algebra listed here, and many others. On Galois fields, the exposition 
in Carmichael!® is particularly straightforward. Van der Waerden!! js 
also a very good source. Albert® is harder to read but is deeper and is 
oriented to the reader interested in finite fields. 


PROBLEMS 


6.1. Construct an addition and multiplication table for GF(7). Find the 
order of each element. Which elements are primitive ? 


6,2. Find all irreducible polynomials of degree 5 or less over GF(2). 
(Note that if a polynomial of degree m is not irreducible it has a factor of 
degree less than or equal to m/2.) Find an irreducible polynomial of degree 
5 over GF(3) . (The first part can be checked against Appendix C.) 


6.3. How many ideals are there in the algebra of polynomials modulo X°-1 
over GF(2)? List their generators. (Answer: There are 7 nontrivial ideals. ) 


6.4. The polynomial 1 + X +X? +X3 4+ X* = p(X) is irreducible over 
GF(2) , and therefore the algebra of polynomials modulo p(X) is GF(2‘). 
Leta designate the residue class {X} , and show that a is not a primitive 
element and therefore p(X) is not a primitive polynomial. Show that 1 +a 
is primitive and find its minimum polynomial, which is a primitive polynomial. 
(Answer; The minimum polynomial of 1+a is 1+X? + x4.) 


6.5, Form tables similar to Table 6,1 for GF(23) and GF(3?) 


6,6, Determine which cyclotomic polynomials are factors of each of the 
following polynomials: X’® .~1, X97) -1, x'?.1, and x? .1 =, 
Determine for each of the cyclotomic polynomials the number and degree of 
the irreducible factors over GF(2), Gheck by finding the factors in Appen- 
dix GC, 
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6.7. Define the reciprocal polynomial f*(X) of any polynomial f(X) to 
be £*(X) = X™£(1/X) , where m is the degree of f(X) . Prove the following: 


a. The polynomial f*(X) is irreducible if and only if f(X) is. 

b. If f(X) is irreducible, f(X) and £*(X) belong to the same exponent. 
Therefore, f£*(X) is primitive if and only if f(X) is also. 

c. If f*(X) = f£(X) and £(X) has degree greater than 2, f(X) is not 
primitive. (The only self-reciprocal primitive polynomials are 
xX? +X+1 and X +1 over GF(2) and X +1 over GF(3).) 


6.8. Show that in the vector space of n-tuples over a field GF(p) , where 
p is a prime, every subgroup (under addition) is a subspace. 
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LINEAR SWITCHING CIRCUITS 


The heart of equipment for encoding and error correction or 
detection with linear codes consists of linear finite-state switching 
circuits. Some circuits useful for implementing linear codes are 
described in Sections 7.2, 7.3, and 7.4. Further properties of 
these circuits are presented in Section 7.5. The theory of the 
general linear finite-state switching circuit is introduced in Section 
7.6, and it is shown that every such circuit is equivalent to a cir- 
cuit of the type described in Section 7. 2. 


7.1. Definitions 


In linear switching circuits, information is assumed to be some 
representation of elements of GF(q) . Three types of devices are 
used. The first is an adder, which has two inputs and one output, 
the output being the sum of the two inputs. The second is a storage 
device, which has one input and one output. It can be a delay device, 
for which the output always is the same as the input was one unit of 
time earlier. It can also be considered to be a single stage of 
shift register. Ina shift register, there is a shift signal, not shown 
in the diagrams, which would usually be supplied by timing circuits. 
When this signal appears, the output of each stage takes the value 
that the input took immediately before the shift signal appeared. 

The third type of device is a constant multiplier, which has one 
input and one output, the output being simply the input multiplied 
by the constant, which may be any field element. The rule for in- 
terconnection of these devices is that any number of inputs may be 
connected to any output, but that two outputs are never connected 
together. The representation of these devices in circuit diagrams 
is shown in Figure 7.1. 


a. Adder b. Storage device c. Constant multi- 
which stores a , plier for multi- 
that is, the output plying by a 
is a 


Figure 7. 1, The building blocks for linear switching circuits 


107 





108 error-correcting codes 


A linear finite-state switching circuit is any circuit consisting of 
a finite number of adders, memory devices, and constant multi- 
pliers connected in any permissible way. Any linear finite-state 
switching circuit can be constructed out of vacuum tubes, transis- 
tors, magnetic cores, or other computer logical circuitry using 
the techniques of digital computer design. In the binary case, the 
adder is an ''exclusive-or'' logical block, and the memory device is 
either a delay device or a single stage of ordinary binary shift 
register. The constant multiplier for the constant 1 is simply a 
connection, and for the constant 0, simply no connection. 

Input and output is assumed to be serial; that is, it consists of 
field elements entering an input line one at a time, one for each 
unit of time. When an input or output is a polynomial, as if often 
the case, only the coefficients appear on the input or output line, 
and they are transmitted high-order coefficients first. The reason 
is that in division the high-order coefficients of the dividend must 
be processed first. Thus the polynomial 


n 
PO PARA a ee 


would be entered on an input line or appear on an output line as a 
succession of n field elements, with i coming first, then | 
one unit of time later, f,_2 after another unit of time, and so 
forth. 


7.2, Multiplication and Division of Polynomials 


Circuits are given in this section for multiplication or division 
of any polynomial by a fixed polynomial. 
The circuit shown in Figure 7.2 multiplies any input polynomial 


k-1 k 
a(X) =a, ta X+... ta, _ Xx + a,x 
by the fixed polynomial 
OE) by #, Kebureuile deg seed 
r-] r 


The storage devices are assumed to contain 0's initially, and the 
coefficients of a(X) are assumed to enter high order first and to 
be followed by r 0's 





Figure 7,2, A cireuit for multiplying polynomials 





linear switching circuits 109 


The product is 
a(X)h(X) = agho + (aghy + a; ho)X 
+ (aghg + a, hy + azho)X? +... 
tilagiphe ¥ ayl phydy rt Netecank 5 a 


Seay et ee Gyles, Wer Gat a Sehidee 


When the first coefficient a, in a(X) appears at the input, the 
first coefficient a;h, of a(X)h(X) appears at the output. At that 


point all the storage devices contain 0's . After one unit of 
time, a,._, appears at the input, a, is in the first storage de- 
vices, and the rest of the storage devices contain 0's . The out- 
put can be seen from Figure 7. 2 to be ay h_+a , which 


is the correct second coefficient in the capone koh hx) 
Similarly after two units of time a,_j is at the input, and the 


shift register stages contain a; 1), a, , Que ck ad gry OO. ss Gi 

The output is a,_ sh, + a,_yhy_, + a,hy_2 » which is the correct 
third coefficient of a(X)h(X) . The operation continues ina 
similar manner. After r+k- 1 shifts, the shift register con- 
tains’ 0; 0,0), .7. , 0, ao) a) 5. and the outputs aohy + ay ho , 
which is the next-to-last coefficient in a(X)h(X) . After r+k 
shifts, the shift register contains 0, 0, 0, ..., a, and the 


output is aghy , the last coefficient of a(X)h(X) , and the product 


is complete. 
Another circuit for multiplication is shown in Figure 7. 3. 





Input 


Figure 7.3, Another circuit for multiplying polynomials 


The product coefficients are developed in the shift negister.,. As 
the first symbol enters the input, the output is a;h,; , and the 
storage devices contain all 0's. After one shift the storage de- 
vices contain ayhy ajch, +++» ayh,_] , and the input is aie ih: 
The output is therefore tiie, 1 + 4 ,h; , which is the correct 
second coefficient, After the next shift the storage devices 
contain ay 14, A a,h, + ay. 1h, » Oh, + ay 1h, Hattie 9) By Ho 

+ ayo phys, , and the “input ia ae 2 : The output is therefore 
ahy. 2 + ay phy.) + My gh, , which is the correct third coefficient. 
The operation continues in a similar manner, 


HRS) érmioreic oni e cit i nig: codieis 


This circuit can be understood in another manner. The set of r 
storage devices form a register that stores a polynomial. Initially 
it is 0. The presence of a, at the input adds aj,h(X) into the 
register. Shifting multiplies by X and delivers the first coeffi- 
cient, whose calculation is complete, to the output. The appear- 
ance of a,j at the input adds a,_ pB(X) into the register, and 
shifting again multiplies by X and delivers the second coefficient 
to the output, and so forth. 

Circuits of the type shown in Figure 7.3 can have more than 
one input. For example, the circuit shown in Figure 7.4 has two 


Input a(X) 





Figure 7.4. A two-input multiplier 


inputs, a,(X) and a2(X) , and the output is 
b(X) = a, (X)h(X) + az (X)K(X) 


where 
hex) ho. Fy ot ae +h x" 
k(X) = kp +k, X +... +x" 


The circuit is shown as if h(X) and k(X) have the same degree, 
but in case the degrees are not equal, r can be taken as the 
larger degree, and the high-order coefficients of one polynomial 
can be 0. 


Example: The circuits shown in Figure 7. 5 multiply the input 
polynomial by h(X) = 1+ x3 + xt+x5 +xX°® over the field of 
two elements. It is instructive to write out the contents of the 
storage devices at each step in the process and to compare with 
the ordinary hand calculation of the product. 
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(+) (+) (+) (+) Output 
ee we a 


Figure 7.5, Circuits for multiplying by 1 + X? + x*4+ x + x®=h/x) 


A circuit for dividing d(X) = dj) + d)X +... +d4,X" by g(X) = 
Roe iR est fee Pi od is shown in Figure 7.6. The storage devices 


Output 








Figure 7.6. A circuit for dividing polynomials 


must be set to 0 initially. The output is 0 for the first r shifts 
until the first input symbol reaches the end of the shift register. 
Then the first nonzero output appears, anditis d (path the 
first coefficient of the quotient. For each quotient Coatticient 

the polynomial qj sh(X) must be subtracted from the dividend. rie 
feedback aneeuttents accomplish this subtraction. After a total 

of n shifts, the entire quotient has appeared at the output, and 
the remainder is in the shift register. The operation of the circuit 
is best understood through a detailed example. 


Example: The circuit shown in Figure 7.7 divides the input 
polynomial by g(X) = 1+ X? + x*+x° +x® | over the field of 


OrLL PLR Or)? O-LPor70 


Figure 7.7. A circuit for dividing by 1 +X3+X4+xX5 +xé& 
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two elements. The step-by-step division of sy Kee ae 
+X74xX44xX34XK41 by 14+ X34+xX*4+X> +X° is compared 
with the step-by-step operation of this circuit in Table 7. 1. 
Note that in ordinary long division the high-order terms are at 
the left, while in the shift register the high-order terms are at 
the right. ote 

The first six shifts have no counterpart in long division. 
After six.shifts the contents of the shift register match the 
polynomial ‘marked A in Table 7.la. The leading coefficient 
is the first quotient symbol, and is also the output after the 


Table 7.1 Comparison of Long Division and the Division Circuit 


(a) Long Division 


xt4x¢4x3 40 +0 +X? 4X41 


KEXP EXE XEEOFOF I +x!) +x0+0 40 










Xo} a x4 x? +0 40 + XH 0 
0 +0 +xX840 + Xo4XS + Xt 
O48 0 tO tBu De 
0 +x®+0 + x*+x5 +x*4x? 
[ee 5 oe 2 So 


Mey 0 Te ee ae et 


x84x7+x°+xX> +0 +0 +X? 
Pl PSE ROE ee eA 


X7+0 +0 +X*+X?4+X? +X 


x7 43° 4 xo 4 X440 +0 


+X 


+x2eo +0 +x*4xX740 +X 48 


x6 4x5 +40 +xX° +x? +0 + 


xo +x) 4+ X44+X? +0 


0 +x*40 +x' 408 


+0 


+ 
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seventh shift. The feedback matches the polynomial marked B, 
and the input corresponds to C, the quantity which is brought 
down. After the seventh shift the contents of the shift register 
match the polynomial marked D. The feedback matches E; 

the term brought down, F, is the same as the input; and after 
the eighth shift the shift register contents match Gs) eibe 
process continues until after fourteen shifts, one for each co- 
efficient in the dividend, the shift register contains the remain- 
der, and all the quotient coefficients have appeared at the out- 
put. 


Table 7.1 Comparison of Long Division and the Division Circuit 


(b) Step-by-Step Operation of the Division Circuit 


j Shift Register Output Symbol Feedback on Input Symbol 
Contents after after jth jth Shift on jth Shift 
j Shifts Shift 

0 000000 0 = = 

1 100000 0 000000 { 

2 010000 0 000000 0 

3 101000 0 000000 1 

4 1) 400150..0 0 000000 1 

MK] Oe Cle a 0 000000 0 

6 CAO TSE0'? 1 000000 0 

7 000001 1 LO OCR Ht 1 

8 vy FO a 1 LO Or Tk 0 

9 110100 0 OP OP TTIY 0 
10 bad 2 0010 0 000000 1 
11 Bad Oi 1 000000 1 
12 Le 0.0 8 1 EO 0111) 0 
13 ee Rie Gt | 1 Ie ide Ge a 1 
ld 001010 0 100111 1 





114 error-correcting codes 


A single shift-register circuit that multiplies by h(X) and then 
divides by g(X) can be made by combining the multiplication cir- 
cuit of Figure 7.3 and the division circuit of Figure 7. 6, as shown 
in Figure 7.8. In this circuit it is assumed that the degree h(X) 
is no greater than the degree of g(X) (See the example that 
follows.) 


Output 





Figure 7.8. A circuit for multiplying by h(X) and dividing by g(X) 


Example: A shift-register circuit for multiplying an de og rae 
nomial by 1+X +X° and then dividing by 1 + xX? 4X*+4+X° +X 
is shown in Figure 7.9. The shift register contains the part of 
the dividend which is being processed. The input connections 
add into the shift register the product of 1+ X + x°® and the 
input symbol, instead of simply adding the input symbol as in 
the division circuit, Figure 7. 6. 

If the constant factor has higher degree than the divisor, then 
stages should be added at the low-order end of the shift register, 
and as many extra shifts with 0 input as added stages are re- 
quired to complete the division. An example is shown in 
Figure 7.10, in which the input polynomial is maeierpr ted by 
1+xX° +X? +x! and divided 1+ X?+X*+xX° +xX° . In this 
case, four shifts with 0 input are required after the coefficient of 
the zero-degree term in the input, to complete the calculation of 
the quotient and the remainder. 


OP PO FOL] 


> 


ag i aaa Moo 


Input 
we 





: : 5 
Figure 7.9. A circuit for simultaneously pe ride ast Fa by. 1+ X 4X 
and dividing by 1+ X> + X*+X° +X 


Output 





b 
Figure 7,10, A circuit for simultaneously multiplying by 
; 14+ X' +X? +X! and dividing by 14X?4+X*4#X*4+x® 
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7.3. Computations in Polynomial Algebras and Galois Fields 


The circuits described in the preceding sections can be adapted 
for use in computations in the algebra of polynomials modulo g(X), 
a given polynomial. 

The shift register of r storage devices in Figure 7.6 stores r 
field elements that can be considered to be the coefficients of a 
polynomial 

r-l 
b(X) = bo +b) X +... + by_ 1X 
which has degree r-1 or less. If the register is shifted right 
once, the contents become 


= 2 r-1 te it 
bX) = b Feb +S FB x - bL_ (gy, * g(X) - X) 


The last term is the result of the feedback connections. This can 
be rearranged to give 


b'(X) = Xb(X) - CaaS 269 g(X) (Whey 8 


Thus b'(X) is in the same residue class modulo g(X) as Xb(X) , 
and since b'(X) has degree less than r , it must be the unique 
polynomial in the residue class Xb(X) that has degree less thanr. 

This can be restated as follows. If S designates the residue 
class containing X , then {b(X)} =b(S) and {Xb(X)} = Sb(S) 
Shifting right once thus corresponds to multiplying by S , and the 
contents of the shift register always are the coefficients of the 
unique polynomial in S of degree less than r 

The ideas will be illustrated using the polynomial g(X) =X4+X+ 1 
and the field of two elements. This polynomial is primitive, and 
therefore {X}=a , which is a root of X4+X+1 , is a primitive 
element of GF(2*) . The corresponding shift register is shown 
in Figure 7,11, If a 1 is placed in the low-order storage device 


me OOH 


Figure 7.11. A circuit for counting in a Galois field code 


and 0's in the others, successive shifts will give representations 
of successive powers of a , a root of X*+X +1 , in exactly the 
same form as they appear in Table 6.1. Note that a 1 shifted out 
of the high-order position corresponds to a‘ and is in effect re- 


placed by its equal a+ 1 by the feedback connections. 
A variation of this circuit is shown in Figure 7.12. A left shift 


corresponds to division of a and a one shifted out of the low-order 
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end, a! , is replaced by its equivalent 1+a* . Thus this de- 
vice can count down, or give Galois field elements in reverse 
order. A multiplier can be mechanized by putting one factor in 
a device A like that shown in Figure 7.11, the other in a device 
B like that shown in Figure 7.12. Then both devices are shifted 


fod-o-0H 


Figure 7.12. A circuit for counting backward ina Galois field code 


until the code for 1 appears in device B . The product then ap- 
pears in A. Division can be done in an analogous manner. 

Multiplication can also be accomplished in a manner analogous 
to the method ordinarily used in a digital computer,* with a shift 
register of the type shown in Figure 7. 11 used as an accumulator. 
This method applies in general to the algebra of polynomials modu- 
lo a polynomial g(X) and in particular to Galois fields. As an 
example, consider multiplying (111 0) ana (1 10-1) “asrele- 
ments of GF(24) as represented in Table 6.1. The contents of 
the "accumulator" are now shown after each operation. Note that 
vector addition is used. 


Multiplier Accumulator Contents 
Baten 0000 
Add 1(1 1 1 0) PTS 
Shift (ho Heap lag 
Add 0(1 1 1 0) Ohied el 
Shift Piece 
Add 1(1 1 1 0) 0001 
Shift 1e15050 
Add 1(1 1 1 0) 0010 Answer 


The value of a polynomial r(X) when the field element a is 
substituted for X can be found also using the device shown in 


*See, for example, Reference 98, 
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Figure 7.6, by taking g(X) as the minimum function of a. The 
Galois field representation of 

n-] 

r(d) =ro t nat... + bela Heh 
can be calculated by eliminating terms of degree higher than kina 


by using the relation g(a) = 0. This is exactly what will result if the 
vector (r9,T],---, Ty_}) is shifted into the device shown in Figure 7. 6. 


Example: Let a bea primitive element of GF(2*) as shown in 
Table 6.1. The Galois field representation of 

mea) ya srg ttle vis. ae e- 
can be calculated by shifting ¥nuj)os+29, Ze intoithe circuit 
shown in Figure 7.11. 


To calculate r(aJ) for j # 1 (or 0) is more complicated if the 
result must be expressed in terms of a polynomial of lowest degree 
in a. One method uses a shift register that automatically mul- 
tiplies by aJ . The example j = 5 should make the principles 
clear, Note that, from Table 6.1, 


la” =o £o + 4" 
aa® =q° =a* + a? 
qe fas) +449" 
aa’ sae = 1 +e 


so that 
5 2 
a°(a) + aja + apa” + aja’) = ag(a + a’) + ay(a” + a9) + az(1 +a + a3) 


+ a,(1 + a’) 


(az + a3) + (ap + az)a + (ao + a, + a3) a? 
+ (a; + a2) a? 


Thus the new value of ag is the old az + a;, the new a, is the 
old aj + az , and soon. A shift register with feedback connection 
shown in Figure 7. 13 will give this result. Then if the received 





Figure 7,13, A eireuit for multiplying by &® in GF(2*) 
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vector (r9, T1,.+-- » ¥14) is shifted into this device, after 
fifteen shifts the result r(a°> ) will remain in the register. 


7.4. Linear Recurrence Relations and Shift-Register Generators 


Consider the recurrence relation, or difference equation, 


k 
bs ha wae (7. 2a) 
j itj 
j=0 
or 
k-1 
ed a 
Fitk 5 sie rd 
j=0 


where hy # 0 and h, =1, and each hj is an element of GF(q) . 
A solution of these equations is a sequence ap , a, , a2 »--. of 
elements of GF(q) . Given the values of aj, a, , ... » ak-] » 
Equation 7.2b is a rule for determining a, . From knowledge 
a, , ag ,..., ap the value of ayy] can be found, and so forth. 
Since the equations are linear, any linear combination of solutions 
is a solution, and the solutions form a vector space. The k solu- 
tions for which one of the symbols ap, a, , ..., ax. is 1 and 
the rest are 0 span the space, and therefore the space of solu- 
tions has dimension no greater than k 

A linear sequential switching circuit that calculates the sum in- 
dicated in Equation 7. 2b and hence calculates a; from the pre- 
vious k values in the sequence is shown in Figure 7.14. The 
initial values aj), a, , ...» ag. ] are placed in the storage de- 
vices. Successive shifts calculate successive symbols, and the 
output after i shifts is always a; . This device is calleda 
shift-register generator, 


Output 





Figure 7.14. A shift-register generator 


The solutions of a linear recurrence relation are characterized 
in the following theorem: k 


Theorem 7.1, Let nix) «) hx? , how 1, hy #0 , and 
jm0 
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let n be the smallest positive integer for which 1 - SC? he 


divisible by h(X) . Let g(X) = (1 - X"™)/h(X) . Then the 
solutions of the recurrence relation 


k 


Ore > hii; (ieee) 
j=0 


are periodic of period n, and the set made up of the first 
period of each possible solution, considered as polynomials 
modulo X™ - 1 


my ZS 
Pic iG go Chee ee ps aa ree se a 


ma <i n-l 


is the ideal generated by g(X) in the algebra of polynomials 
modulo X" - 1 . Note that with a(X) defined in this manner, 
if ag, a; , ... are generated in order of increasing index, the 
coefficients of a(X) are generated high-order first in accord- 
ance with the convention stated in Section 7.1. 


Proof: First it will be shown that, if {a(X)} is in the ideal gen- 
erated by g(X) , then the sequence of period n 


AGS Aes Gee's) ee ys SOF ay » «+. Gis) 


is a solution of Equation 7.2a. Consider the product, 


{a(X)} {h(X)} = {c(X)} 


where 
eal Se Ae wo + +t eee 
2 TAG ay iataaa n-2 n-l 
h(X) = hp +h) X +... +h, XK 
and 
Sky Wey FO) he) PO +e, x* 


Comparison with Equation 6.8 shows that if kif<Sn- 1 


C= hoa, tha, 2 a ee date ca) OL: (7. 4) 


-1-2 -2 k n-1-Q+k 


whereas if 0S 2<k , 
Fd hot ag + haat yeh es heey 
| ho 140 + hoy 2% oe See a a (75) 


By Theorem 6, 12, if {a(X)} is in the ideal ({g(X)}) , 
{a(X)} {h(X)} = 0, and therefore every cg #0. 
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Now consider the sequence given in Equation 7.3. Init, aj=aj,, 
for all i2 0. This makes the recurrence relation, Equation 7. 2a, 


exactly equivalent to one or the other of Equations 7.4 or 7.5; and 


thus if {a(X)} is in the ideal generated by g(X), the sequence in Equa- 


tion 7.3 is a solution of the recurrence relation, Equation 7.2. 

Since g(X) = (X™ - 1)/h(X) has degree n-k , the ideal ({g(X)}) 
has dimension k , by Theorem 6.11. This is the same as the 
dimension of the space of solutions, and therefore by Theorem 
2.9 must include all solutions. 

Some of the solutions may have period less than n , but there 
must be some that do not. In particular, the solution obtained 
from {g(X)} has period exactly n . This can be shown as fol- 
lows. If it has period m less than n , thencertainly n isa 
multiple of m , and each block of n symbols consists of n/m 
identical blocks of m symbols. For this to be the case, it must 
be that 


Pease Veo see 


Then 


~~ 


= @xiik -2/(K, =) 


(x™ = 1)(x™ - 1) = h(X)g(X)(X™ - 1) = h(X)q(X)(X™ - 1) 
and 
(x - 1) = h(X)q(X) 


which contradicts the assumption that n is the smallest integer 
for which X” - 1 is divisible by h(X) 
QED 


Example: Over GF(2) determine the period of solutions of the 
difference equation corresponding to h(X) = X*+X34+X+1= 

(X + 1)°(X? +X +1) . The factor X7+X+1 divides X> +1 , 
and so does X +1 , but in order for X" +1 to be divisible by 
x? +X +1 and (X +1), n must be taken tobe 6. The 
period must therefore be 6. Some solutions will have period 
less than 6, but there must be at least one solution that has 
period 6. The generator of the ideal from which the solutions 
are formed is g(X) = (X° - 1)/h(X) =X? +X +1 , and this cor- 


responds to the solution 111000 . The other solutions are 
all vectors in the row space of 
Lo} T0000 
G-= On VoL sEOs0 (7. 6) 
CX0"L FTO 
Ov! Ovk Ia 
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In particular, the sum of the first two rows, 100100 , 
actually has period 3, and the sum of the first three rows, 
101010 , actually has period 2. 

As a further example, the binary shift-register generator 
corresponding to the polynomial h(X) = X® +x° +x5 +x341 
is shown in Figure 7.15. This polynomial is primitive, and 
therefore divides X?°> - 1 but does not divide X" -1 for any 
smaller n . Thus the period of the shift-register output 
sequence is 255, which is the maximum length possible for an 
8-stage shift-register generator. (See Section 8.3 for further 
details. ) 


a Sn A ES) 

i mtg Oa ns ns OO a i (he 

Figure 7.15, A shift-register generator for maximum-length 
sequences 


For the purpose of studying cyclic codes, Theorem 7.1 gives 
the essential facts in the most convenient form. Other ways of 


studying linear recurrence relations will be described only briefly, 


Consider the recurrence relation corresponding to h(X) , as 
described in Theorem 7.1. Let a be any root of h(X) , perhaps 
in an extension field. Then the sequence 

I Literate ake 1 ie Sa (Te) 
obviously satisfies the recurrence relation. Since the recurrence 
relation is linear, any linear combination of sequences of ascend- 
ing powers of roots is a solution: 

bee 3 Crag #1245 4 Cet (7. 8) 

j je 

where a, , a2, ..., a, are the k roots of h(X) . (This as- 
sumes that all roots are distinct.) Since it is known that the space 
of solutions has k dimensions and since there are k arbitrary 
constants here, this must be a complete set of solutions. This is, 
of course, analogous to the classical method for solution of linear 
differential equations, and there is a close parallel with transform 
methods, with the roots of h(X) playing the role of roots of the 
characteristic function or poles of the output function of an ordi- 
nary linear system, 

Now suppose that h,(X) is an irreducible factor of degree k, 
of h(X) . Let a be a root of h,(X).Then over GF(q) , a and 
its powers can be written as vectors with k, components. 
Clearly each component in Sequence 7,7 must satisfy the recur - 
rence relation, This corresponds to the fact in the study of linear 
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differential equations that if a complex-valued function satisfies Lead #5 ALO 
an equation with real coefficients, both the real and imaginary Sean) = (0.1 0 0) 
parts of the complex solution are real solutions. 
P : s? = {x?} = (0010) 
Example: Let a be a root of X? +X? +1 over GF(2) . Then ; 3 
the field elements in the extension field GF(2%) can be repre- s = {x} Rare 
sented by column vectors with three components from GF(2) , st = {1+ X* +xX3}= (1011) 
Re Oo! pa ale ie ars as Ss fie ¢X% eu (22.1.0) 
(7. 9) s&§ = {X+xX74+X3}= (0111 
1 O20e14) E16 { } : 
Ost ORO ee] andweitiig. 2. $4 8? 8%, 8* 5:87. S® as column vectors 
gives a matrix 
POLAT 1000110 
Each row of this matrix satisfies the recurrence relation OF 17010 WAteE (7.11) 
ald 
O= a; +a, +a, OOo Oo 
i i+2 i+3 
0.0.0 ay 0°2 


corresponding to the polynomial 1 +x? + x3 

Now consider the polynomial (1 + X)(1 +X + X%) = 
1+’ +x? +x* and the corresponding recurrence relation 
Ora; + aj42+ aji4g + ai44g . If B is a root of 1 eck? Kt, 
then 1, 8B, B*, 62, Bt, & , B® satisfies the recurrence re- 
lation. Since 1 is a root of (1+ X) , so does 


EOS toate oy arg pe Ge er re 


With use of the representation of GF (23) given by polynomials 
modulo X* +X +1 , the successive powers of f give the top 
three rows of the matrix M , and the last row is the row of 
powers of 1. Thus each row is a solution, and the set of all 
solutions is the row space of M: 


10:20? WiOete 


0 LAP Oa Sh A eo) 
Me (7. 10) 
Oe Odi Ovalortial: 


bias Uy RH pt rh! 


Alternatively, consider the algebra of polynomials modulo 
1+ X* +x34+xX*, and let S denote the residue class that con- 
tains X . Then since 1+S* +S'+S‘*=0 , 


is. SH asee Bese ee Ame 


satisfies the recurrence relation, Note that S is not a field 
element. Then each element of the algebra can be represented 
by a vector 





Now every row of this matrix is a solution of the recurrence 
relation, and every solution is in the row space of this matrix. 


Still another approach is to employ the concept of a ''quotient 
field" of polynomials. The rigorous treatment is given by 
Zierler,'*® and only a statement of the main theorem and an ex- 
ample will be given here. Zierler's theorem states that if any 
polynomial f(X) degree k - 1 or less is divided formally by long 
division by h*(X) = h)X<+h, X14... +hy, the coefficients 
of the resulting nonterminating quotient satisfy the recurrence 
relation 


O= hoa; +h) ajyy Pas + hyaige 


Example: Let h*(X)=1+X + x?. Then, by long division 
TS YS 1 eK KX? 4X4 4 Xx? 4+ Ko + x? EE wD, 


and the sequence of coefficients, 1110100111 OO" Gie ees 
agrees with each row in Equation 7.9. 


The circuits described in this section and Section 7.2 are 
analogous to linear filters and feedback systems. They are, in 
fact, sampled-data systems, the only important difference from 
conventional systems being that the quantities are elements of a 
finite field here and are real numbers in conventional systems. 
The transform methods used for sampled-data systems apply here, 
and indeed the mathematics involved is that discussed in the pre- 
ceding paragraphs, These ideas are pursued further in the following 
section, 
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7.5. Analysis of Linear Switching Circuits 


Analysis of the outputs of the circuits described in Section 7. 2 
with arbitrary input sequences is given in this section. The se- 
quences of input or output symbol are designated 


ao, a, , a2, 


with ag as the first symbol. (The fact that here the subscript 
increases with time, whereas in dealing with polynomials the 
high-order coefficients come first, is an annoyance, but any 
other convention would also lead to minor difficulties. ) 

Results are more simply stated in terms of the transform of 
the sequence 


a(D) =a) + a, D+ a,D° Pee ib) 


This can be considered also as a formal power series, or merely 
a way of representing the sequence. 
Multiplying a sequence by D gives 


Dal.D)aaoD.4a;-Ds 4 ‘aD? 4h.) 


which corresponds to the same sequence delayed one symbol. Thus 
D can be considered as a delay operator. In dealing with poly- 
nomials, multiplication by X advances the coefficients one posi- 
tion, and multiplication by X7! delays them one position. Thus 
ina sense, D= easel 

Direct analysis of the operation of the multiplying circuits shown 
in Figures 7.2 and 7.3 shows that for either of them the relation- 
ship between the input sequence a(D) and the output sequence b(D) 
is given by the difference equation. 


b(D) = ha(D) +h, |Da(D) +h ,D*a(D) +... + hoD*a(D) 


23 


h*(D)a(D) (7-13) 


where h(X) =hyp +h, X +... + h,X* is the reciprocal poly- 
nomial of h*(X) = h)X7 +h, X™71 4... 4h,. (This assumes that 
the storage devices contained 0's initially.) Thus this circuit 
simply multiplies the input sequence by h*(D) , and h*(D) is 
called the transfer function for these circuits. Of course this 
circuit was designed to multiply. The reason that the circuit mul- 
tiplies by the reciprocal polynomial h*(D) is that D = X71 

Similarly, for the circuit shown in Figure 7, 4, the inputs a, (D) 
and az(D) are related to the output b(D) by the difference equa- 
tion 


b(D) = h* (D)a; (D) + k**(D)a, (D) (7. 14) 


Example: If the input to either of the circuits shown in Figure 
7.4 is the sequence 11010111001,.., formal mul- 
tiplication of the input sequence transform 
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a(D) = 14D+D*+D°> + D* + D’?4+ D+... 
by the transfer function h*{D) =1+D+ Dp? + D? + Dé eee 
a(D)h*(D) = 1 + D? + D§+ D? + 0D'+... 


and this is as far as the product can be determined from the 
given symbols of the input sequence. This is the transform of 
the circuit output. 


The circuit in Figure 7.6 is designed to divide, and it does so 
even with an infinitely long input sequence. If the transform of 
the input is divided formally by g(D7') =D 7"g*(D) , the result 
is the transform of the output sequence. Similarly, a circuit 
designed to multiply polynomials by h(X) and then divide by g(X) 
gives the same results as formal multiplication by h*(D) and 
division by g*(D) , except for a possible delay. 


Example: If the input to the circuit shown in Figure 7.7 is 

LP OVL [20; O00. 1 Ora Tia, the outout.1e 
020'050°0'OhdrT Ongn lat «: This can be verified by the 
simulation of the circuit, and can be obtained also by formal 
long division of the input transform, a(D) = 1 + Dp De 
+D? +D!4p"4% 4+D%4+_... by D-eg*(D) = D-°(14+D+D*+D*4+ D4. 
This should be compared with the example on page 111, where 
the same input sequence is used in a different context. 


The behavior of the division circuit is also governed by a dif- 
ference equation. The equation can be derived from that for the 
multiplication circuits as follows. The two-input multiplication 
circuit, Figure 7.4, becomes a division circuit, Figure 7.8, if 


k(X) = -g(X) + gx" (7. 15) 


and if the output is multiplied by s° and used both as the quotient 
and the second input. Then Equation 7. 14 becomes 


b(D) = go? (h* (D)a, (D) + (-g*(D) + g,)az(D)) (7. 16) 


and 
az (D) = b(D) (Zain) 


Substituting Equation 7, 17 into Equation 7, 16 and rearranging 
give 

h*(D)a, (D) = g*(D)b(D) (i?ee18) 
which is the desired difference equation, Formally dividing by 
g"(D) to solve for b(D) gives 


» H*(D) 1.1 
b(D) » ipy (PI (7. 19) 
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and h*(D)/g*(D) is called the transfer function of this circuit. 
It should be noted that the circuit shown in Figure 7.4 requires 
the degrees of h(X) and g(X) both to equal rp . Equations 7.18 
and 7.19 hold for other cases as long as g*(X) is taken as 
XT p(X-1) and h*(X) as X~Th(X7?). 

Example: The transfer function of the circuit shown in Figure 


Rr OAS 


pDt®(1) De 
- - - - = 
Dt(1+D3+D?+D+D°) Dé’+D+D°+Diil 


For the circuit of Figure 7.9, the transfer function is 


D*{i.+ D7}.+.D7%) Deets DaettaD 
MER OUIE <P REA SE TLR ES TOD COT TAD LTE OPE ae ence fh 
DA Datasets?) 8D) © yp Ue Fas Deep api 


and for Figure 7. 10, 
Beret eo fp * - DY’ +pD> +Dil 
erp? 25" 4 O42 Dp? 4 OMY Do ee es 


It is possible for a circuit to have an output when the input se- 
quence is all 0's if the storage devices contain nonzero elements 
initially. Such a sequence is analogous to transient response of 
an electrical network. 

Assume that a circuit has the transfer function 


api -1 
O79 koi +h,)/(goD> + gib*® pape. eS) 


h*(D)/g*(D) = (hpD® + hyD 
Then the input a(D) and the output b(D) are related by the equation 
g*(D)b(D) = h*(D)a(D) 
and since there is no input, 
g*(D)b(D) = 0 (7. 20) 


The coefficient of each power of D must be 0. Thus, for di 


x. 
y 0.4; 7 (7.21) 
j=0 


The solutions of this equation are characterized in Theorem 7. l, 
Section 7, 4. 


Example: It is easily verified that the circuit shown in Figure 


7.7, with the initial conditions 100111 and with no input, gives 


the sequence 100111001000001... as its output. 


For a circuit with given initial conditions, there may be an 
input sequence that results in an output sequence of all 0's, Such 
an input sequence is called a null sequence of that circuit, Assume 
again that the cireuit has the transfer funetion h*(D)/g*(D). Then 
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the input and output are related by the difference equation 
g*(D)b(D) = h*(D)a(D) 


For a null sequence, b(D) =0, and therefore, 


h*(D)a(D) = 0 (7. 22) 
Lob 

s 

- ha =0 (7. 23) 

j=0 


Furthermore, if h*(D)a(D) = 0, then g*(D)b(D) = 0 also, and the 
output sequence is a transient response for the circuit. It can be 
shown that there exists a set of initial conditions corresponding 
to each solution of Equation 7. 23 for which the output is all 0's . 
Thus the null sequences are the solutions of Equation 7.23. Solu- 
tions of this equation are characterized by Theorem 7.1, Section 
7.4. 


Example: In practice it is easier to find a null sequence cor- 
responding to a given set of initial conditions than to find the 
initial conditions corresponding to a given null sequence. Con- 
sider the circuit shown in Fig. 7.5a, with initial conditions 
(100000) . Then if the output is to be 0, the first input must 
be 1, and after a shift the storage devices contain 110000. 
Now for the output to be 0, the next input must be 0, and the 
storage devices contain 011000 after the shift. Similarly 
it can be verified that the null sequence must be 
100111001000001 ..., and it repeats this pattern 
with period 15. This is the same sequence as was found in the 
preceding example. This agrees with the fact that both must 
satisfy the same difference equation 


(1+ D+D? + D>? +D°)b(D) = 0 


7.6, Analysis of a General Linear Finite-State Switching Circuit 


A general description of an arbitrary linear finite-state switch- 
ing circuit is given in the following paragraph. The principal re- 
sult in this section is that every such circuit has a transfer function 
of the type discussed in the preceding section; thus if the circuit 
is treated as a black box with only the input and output accessible, 
any linear finite-state switching circuit is indistinguishable from 
one of the type described in Section 7. 2. 

Consider an arbitrary linear switching circuit with r storage 
devices, 8 input lines, and t output lines. Then the output of 
the r storage devices at time i is an r-component vector Wipes 
and the input to the storage devices at time i is the next output 
Vi-1 + The vector vj im called the state of the circuit, 
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Similarly, the circuit input is an s-component vector uj , and 
the output is a t-component vector wj . The input vj,) tothe 
storage devices is a function of the output v; of the storage devices 
and the circuit input uj; . Since the circuit is made up only of 
adders and constant multipliers, the function must be linear, and 
can therefore be expressed in matrix form: 

v. =v. Tu (7. 24) 

i+] i i 

where T isan rX r matrix and U isan sxXr matrix. Simi- 
larly, the output w; is a linear function of the input and the con- 


i 
tents of the storage devices: 


w. =v.R +u,S (7225) 
i i i 


where R isan rxt matrix and S isan sXt matrix. 


Example: The matrices for the circuit of Figure 7. 5a are 


010000 
001000 =i [14 070NC'-070)) 
re [200100 Rb =[(111001] (7.26) 
000010 s =(1] 
000001 
000000 


where the components of v; are the contents of the storage 
devices in the same order. For Figure 7.5b, T andS are 
the same, but 


Use aieo ot 11] 
T (7.27) 
Ree = (0000-02024) 
For Figure 7.7, 
010000 
001000 
u =[100000] 
000100 
T= RT=(00000 1] (7, 28) 
000010 ¥ 
Ss) = 104 
000001 
LZOLOM alee 
In Figure 7.9, only U is different: 
U=[{110001) (7, 29) 


In each case the matrices completely describe the circuit 
connections, 
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Let A bea nonsingular rXr matrix and let 


vi = vA Ti? tie “> (7. 30) 


Then if Vj is known, v! can be found, and vice versa, and each 
contains the same information. The vector v! can be considered 
as representing v; ina different coordinate system, A switching 
circuit for which the successive states are v! instead of v. can 
be formed by substituting Equation 7.30 for v; in Equations 7. 24 
and °7..25. 


1 Av} rn ta -l 
Viel vi T + u,U 


or after multiplication on the right by A , 


vi =viA TA +u.UA = v'IT! + u.U! (7.32) 
i+] i i i i 


and 


w, =viA7'R +u.S =v!R' +u,S! (7, 32) 
if pi 1 a 1 

The new circuit will for a given input have the same output as the 
old circuit, though the internal connections are different and the 
state vectors are different. Thus the matrices for the new circuit 
are 


Tl sArl TA AUtelUAs Ree AttR Uslsis (7. 33) 


The relationship between T and T' given in Equation 7. 33 is 
of great importance in the theory that follows, Matrices T and 
T' related by the Equation T'=A7!TA are called similar 
matrices (Reference 5, page 83; Reference 7, page 297; Reference 
75, page 112). 


Example: Consider the matrices corresponding to the circuit 
in Figure 7.7 and given in Equation 7.28, and let 


0-000 0 2 (Ol tee Gea ie sf 

OOF OF Ow 1, a ORT 110 

0070-11 0 tl deeds O10 
Ags ADs 

00.2 10.0 Ly t..0%0:.0 

0:1,10'03 110000 

Tt OO 0 2 100000 


Then 
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000001 

100000) yu -euA =[000001] 

Tits A? TA=(910000] pipe (a-tRy? =[100000] 
000101 
000011 


The corresponding circuit is shown in Figure 7.16. This circuit 
can be used to divide polynomials, just as the one in Figure 7.7. 
The quotient will be correct, since the output is the same for 
either circuit. However, the contents of the storage devices 
after division will not be the remainder, since the contents of 
the storage devices differ in this circuit according to Equation 

er SOly 


Input 


SS aan ong aera 
bela Lakee eae lage ae 
Figure 7.16. A circuit equivalent to the circuit in Figure 7.7 


Consider now the behavior of a circuit with no input, which is 
sometimes called the autonomous behavior. Then u;=0 , and 
Equation 7.24 gives vi4] = v,T » Vi-2 = Vi4yT = v,T » andin 
general, 


v..,#v,T) (7. 34) 
ty 1 

It is known that every r Xr square matrix satisfies a minimum 
polynomial with coefficients that are field elements and that has 
degree no greater than r (Reference 5, page 83; Reference 7, 
page 215: Reference 75, page 77). Thus there exists a polynomial 
m(X) = mp +m ,X +... + m,X* such that 


m(T) = mp +m T +... +m, T° =0 
Then 
MoVe st my Vache +mg,viT> = 0 
or 
Movi + Mi Vi4+] +--+ + Mgvit+g = 0 (Tea) 
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Thus each component of vj (that is, the sequence of contents of 
each storage device) satisfies a homogeneous difference equation, 
Equation 7.35. Each output is a linear combination of the contents 
of storage devices, and therefore each output is also a solution of 
Equation 7.35. Solutions of this equation are characterized in 
Theorem 7.1, Section 7.3. 


Example: Let 


00100001 
10000000 
01000000 
00100000 

T= 100010000 
00001000 
00000101 
00000010 


with elements from the field of two elements. Then the char- 
acteristic polynomial of T is 


det [IX - T] = X®°+X°+xX° +xX941 


which is primitive, and hence irreducible, The minimum 
polynomial must divide the characteristic polynomial, and 
therefore this must also be the minimum polynomial (Reference 
5, page 84; Reference 75, page 79), This matrix corresponds 
to the circuit shown in Figure 7.17. It has the same possible 
output sequences as the circuit shown in Figure 7.15, since it 
is governed by the same difference equation, but it requires one 
fewer adders and otherwise the same number of components. 


a 
ont Lo OOP 


Figure 7,17. A circuit equivalent to the circuit in Figure 7.15 





For any monic polynomial g(X) = go + gi.X +... + my tale + x* 
there ig a companion matrix 
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0 1 0 0 
0 0 1 0 
gad = i ; : ‘ (7. 36) 
0 0 0 1 
-So- 81-82 8 - By) 


(Reference 5, page 85; Reference 7, page 308). Sometimes the 
companion matrix is defined as the transpose of Equation 7. 36 
(Reference 75, page 81 ). 


0 0 ee 0 Gay i) 
i Ole? . ane ae seRt 
0 Pes at. Ole 
To = ; - : ; Chey 
0 Oe eo ae = Borg 


It can be shown g(X) is the minimum polynomial of both bs 
and Ty) . The matrix T, given in Equation 7.36 corresponds 
to the circuit shown in Figure 7.6 with the input omitted, while 
the matrix Ty) corresponds to the circuit shown in Figure 7. 14. 
The difference equations given previously (Equations7. 21 and 7. 2, 
respectively) agree with Equation 7.35. 

If T is an rX r matrix and if the degree of its minimum poly- 
nomial m(X) is r , then T is said to be nonderogatory. Every 
nonderogatory matrix is similar to the companion matrix of its 
minimum function (Reference 75, page 123). That is, if T is 
nonderogatory, there exists a matrix A_ such that Aa? quAis ie ; 
where T, is the companion matrix of m(X), the minimum poly- 
nomial of T . Then the circuit corresponding to T, and the one 
corresponding to T satisfy the same difference equation. These 
circuits are equivalent — they differ only in the way the state is 
represented. 


Example: In the example on page 129, the matrix A transforms 
the matrix T into T', which matches the companion matrix in 
Equation 7.37 inform. Note that if the circuit in Figure 7. 16 
is loaded with initial conditions matching the first row in A, the 
successive contents of the storage devices are the other rows. 
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This method of finding the matrix A to transform a given non- 
derogatory matrix to canonical form is given in Reference 75, 
page 122. 


Every derogatory matrix T is similar to a matrix of the fol- 
lowing form: 


M, 0 0 
MM: . 0 
(7. 38) 
Oe ee ae 
m 





where M,, is the companion matrix of the minimum function of 
T , and each other Mj; is the companion matrix of a polynomial 
p;(X) . Furthermore, each pj(X) divides pj, )(X) . This is 
called the rational canonical form (Reference 5, page 86; Refer- 
ence 75, Chapter 6). 

In the corresponding circuit, there are no interconnections be- 
tween storage devices corresponding to columns in different 
matrices M; and M; . Thus the circuit consists of isolated 
parts corresponding to M,, Mz, ..., My, . Each output is 
a linear combination of contents of storage devices possibly in 
several or all of the isolated parts. Furthermore, every p;(X) 
must divide the minimum polynomial p(X) of T , and there- 
fore, by Theorem 7.1, every possible output of each part of the 


circuit is a solution of the equation Pm(P)w; =0 . It follows 
that every output sequence is a possible output sequence of the cir- 
cuit corresponding to the matrix M,, alone. 


Thus every autonomous linear sequential switching circuit is 
equivalent either to a circuit of the type shown in Figure 7. 6 (in 
the nonderogatory case) or to a collection of several such circuits 
isolated, except that their outputs may be combined (in the deroga- 
tory case). 

The preceding development can be generalized to include the in- 
puts, though it is more cumbersome for this case: 


Vv. sv.T+u,L 
it] i i 


Vv Tae arr mLe rt ay To tat +u,, L 
it i i 1 1. 2) 1 


ve ae ee | 1 +1 +1 


and in general, 


Vv avi™ +u LT au vr 1 


40 3 
rot eat i it] yO bt:'99) 
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If m(X) =m) +m,X+... + m;X” is the minimum polynomial of 
the matrix TT 4 sthen ats) = 0. , and 


Movi + Mi Vi¢q +... + Myvi4sy 
=vym(T) + uj(m,; LL + mzLT +... + gyLT*) 
r-2 
+ ujyy(m2zL +m;LT +...+m)LT °) 
+... tUjyy. ym L 
m(D)vj = ujlo + ujgyly +... + ujgr yLy_1 (7. 40) 
where 
r-l 
Lo ery pane DO he), om ol ) 
r-2 
1) =(mzL+m,LT +... +m, ,LT ) 
(7. 41) 
Lo =m_L 
r- 1 r 
Then by Equation 7. 25, 
x r < 
iY: we = y mV R + > mo. |S 
J 4ty y aes Jat 
j=0 j=0 j=0 
r 
=ujyLoR + ujyzyL, R +... + ui¢r-pbr-1R +) mn Hi 4 55 
j=0 
(7. 42) 


In the case of a circuit with a single input and a single output, S 
is a1X 1 matrix, that is, a scalar, and so is LjR for each j 

When Equation 7.42 is transformed, that is, written in terms of 
D , it takes the same form as Equation 7. 18, and this circuit is 


described by a difference equation like Equation 7, 18 or equivalently 


by the corresponding transfer function, Equation 7, 19. 

Again the matrix T plays the key role, since it describes the 
interconnections among the storage devices, Again the "change of 
coordinates" described in Equation 7,30 can be used to finda 
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matrix T!' similar to T but ina special canonicalform. If T 
is nonderogatory, then T' is the companion matrix of the mini- 
mum polynomial of T . The circuit corresponding to T' has 
basic feedback connections like those of Figure 7.6 if the com- 
panion matrix of Equation 7.36 is used, or like those of Figure 
7.14 if the companion matrix of Equation 7. 37 is used. Connections 
may be made from any input line to any storage device, and from 
any storage device to any output line. 

In the derogatory case, the matrix T' has the form given in 
Equation 7.38 and, as in the autonomous case, the circuit consists 
of a collection of circuits of the type shown in Figure 7.6 or 
Figure 7.14. Again connections may be made from any input line 
to any storage device and from any storage device to any output 
line, but otherwise there is no connection between the individual 
circuits corresponding to the individual matrices on the diagonal 
of Equation 7. 38. 

It should be noted that it is always possible to realize a circuit 
with a given transfer function using a number of stages equal to the 
larger of the degrees of the numerator and denominator of the 
transfer function. In sucha realization, T is nonderogatory, and 
a circuit with a derogatory matrix has more components than are 
necessary to realize its transfer function. 


NOTES 


The linear filter viewpoint in the study of linear switching circuits origi- 
nated with Huffmann. °?> 64 Section 7.5 is based entirely on his work, and 
the circuits described in Section 7. 2 appear in Reference 63, Simultaneous - 
ly, Zierler, 124,126 Golomb, ™ Blankenship, Albert, and perhaps others be- 
came interested in shift-register generators as a means of generating 
pseudo-random sequences. More recently the connection of shift-register 
generators with error-correcting codes™ has given further impetus to their 
study , 3938:43,44,60,122 Theorem 7,1 appears in Reference 87, and is very 
similar to results of Hall. ” 

The matrix methods of analysis used in Section 7. 6 are the same as those 
used by Birdsall and Ristenbatt® and Elspas*° in the analysis of autonomous 
linear switching circuits. It is a very natural method, and in fact some of 
the basic work on cyclic codes has been done in this context, rather than in 
terms of polynomial algebra, the viewpoint used in this book. Albert 
(Reference 5, page 85), in the course of introducing the companion matrix 
of a polynomial, gives an interesting comparison of these two approaches’, 
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PROBLEMS 


7.1. Devise three shift-register circuits like that in Figure 7. 13 with 
periods 7, 21, and 63. (Answer: Period 21 can be achieved with polynomials 
x°+X44+ xX? +X 41 or (1 +X +X?)(14+X + X3) or their reciprocal poly- 
nomials. ) 


7.2. Show that if h(X) is irreducible all the sequences generated by the 
corresponding shift register generator have the same period. 


Ta sueset ise iewar 6 dice, eee ape and Hotell tis, Ose oe ap 4), 
where a; and ag are elements of an extension field and a@=af=1 . If 
these field elements are expressed as vectors of m,; and mz components, 
respectively, over GF(q) , then H, is an m, X n matrix and Hz is an 
mz % n matrix. Show that if a,j and az have the same minimum function, 
the row spaces of H, and Hy, are the same, but if the minimum functions 
are different, no vector in the row space of H, is in the row space of Hp , 
and vice versa. (Hint: Use Theorem 7. 1.) 


7.4. (Reed’>) Let a; be any maximal length sequence of period q™ - 1 
over GF(q) . Define multiplication of vectors as follows: 


a. Ov = v0=0 
b. Denote by a; the vector (a; F ait] sPle are wd aj+m-1) and then 
OjMye F O52 5 #OF# a, 

Show that with this definition the vectors form a field. 

(With this definition of field elements, successive powers of a appear 
upon successive shifts in a shift register of the type shown in Figure 7. 14. 
It can be adapted for calculating r(a) also in a manner analogous to that 
described in Section 7. 3.) 


7.5, Devise a circuit for squaring a field element and a circuit for taking 
the square root of a field element in GF(2*) as it is represented in Table 6. 1. 
Note that in GF(p™) the p* power and hence the pt root are linear opera- 
tions, by Theorem 6.14. Use a method similar to that given on page 117 for 
automatic multiplication by aJ , which is alsoa linear operation. 
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CYCLIC CODES 


Several of the codes described in Chapter 5 are equivalent to 
cyclic codes, and as cyclic codes they are most simply mechanized, 
The very promising new codes described in the next three chapters 
are cyclic codes, and the outlook is that more cyclic codes will be 
found to be attractive for error detection and error correction. 
Much of the basic theory and techniques for coding and calculation 
of parity checks applies to all these codes and is described in this 
chapter, Error detection is discussed in some detail. Complete 
coding and error-correction procedures are described for cyclic 
Hamming codes at the end of the chapter, and these serve as an 
introduction to coding and error-correction procedures for the 
Bose-Chaudhuri and Fire codes described in the next two chapters. 


8.1. Cyclic Codes and Ideals 


A subspace V of n-tuples is called a cyclic subspace or a 
cyclic code if for each vector V = (ao, a, , ... 5 apne 1) eee, 
the vector V'=(a,_), a, a, » an_2) obtained by shifting 
the components of V cyclically one unit to the right is also in 
Ve 

In this chapter, n-tuples will be considered to be elements of the 


algebra A, of polynomials modulo X"-1 . The elements of the 
algebra are residue classes of polynomials, and here they will be 
designated {f(X)} . Unless there isa specific statement to the 


contrary, f(X) will always be taken as the polynomial of smallest 


degree in the equivalence class. Then f(X) always has degree 
less than n , and every distinct polynomial of degree less than 

n is ina distinct residue class; that is, there is a one-to-one 
correspondence between polynomials of degree less than n and 
equivalence classes. Given a polynomial a(X) of degree greater 
than n , the polynomial of smallest degree in the same equivalence 
class is found by dividing a(X) by X™-1. The remainder is the 
desired polynomial. 


Corresponding to each n-tuple (ap, a; , ..., ay-y) there isa 
polynomial of degree less than n, f(X) =aj +ta;X +... + eS See 
and hence a residue class {ap +a,)X +... +ap,.yX"™-1} . The 


residue class and the vector will be considered as simply different 
ways of representing the same thing, namely, an element of the 
algebra A, of polynomials modulo X" «1, 


147 
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The following theorem gives an algebraic characterization of 
cyclic codes: 


Theorem 8.1. In the algebra of polynomials modulo X™- 1, 
a subspace is a cyclic subspace if and only if it is an ideal. 


Proof: The key point is that multiplication by {X} is the same 
as a cyclic shift, for 


Vtas + a7% + 0... + an 1x )) YE Cob ae eT on a 


ze 
+ ay y(X - 1) 


and therefore 


4 


n- 1 n- 
{X}{ap tay X+...+¢ apn jX } = fa.) tayX+a,X? +... +a, 5X 


If the subspace V is an ideal and v is any element of V , then 
{K}v is alsoin V , andsince {X}v is the cyclic shift of v , 
V is acyclic subspace. 

Now let us assume that V is acyclic subspace. Then for any 
vin V , {X}v isin V , and therefore for any j , {X}Jv= 


{Xj}v isin V . Since V isa subspace, any linear combination 
=i 2 

Cov +c; {(X}vt... + Cy {X" Fives {Go + Goce eeu +¢,.)X" tt 

is in V . Thus the product of any element of V and any element 


of the algebra A, isin V , and V must be an ideal. 
QED 


The structure of ideals in A, is described in Section 6.4. It 
may be summarized as follows: Let g(X) be the monic poly- 
nomial of smallest degree such that {g(X)} is in an ideal I 
If f(X) is a polynomial of degree less than n which is divisible 
by g(X) , then {f£(X)} isin I , andconversely, if {f(X)} is in 
I, f(X) is divisible by g(X) . Also, g(X) divides XN -1 , 
and every monic polynomial that divides X™ - 1 generates a dis- 
tinct ideal I in A, . The polynomial g(X) is called the genera- 
tor of the ideal. 

A cyclic code is therefore specified completely by a polynomial 
g(X) that divides X"-1 . Alternately the code can be specified 
completely by the statement that it is the null space of the ideal 
generated by h(X) = (X" - 1)/g(X) . If g(X) has degree r , 
then by Theorem 6.11 the code has dimension k=n-r . The 
element {f(X)} is in the code if and only if f(X) is divisible by 
g(X) 


Example: 1 - X’ =(1 - X)(1 +X + X3)(1 +X? + X3) over GF(2). 
The polynomial g(X) = 1 + eee ta generates a cyclic (7, 4) 
code. The elements 
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{g(X)} =(101100 0) 120-210; 01:0 
{Xg(X)} = (0 101100) OrOr1e 120 0 
= Ses 
{X? g(X)} = (0010110) Gtloor0rr0)| 
and 
{X3g(X)} = (0001011) Orono: 120% 1/1 


may be taken as basis vectors, and therefore G may be taken 
as the generator matrix. This code is the null space of the 
ideal generated by h(X) = (1 - X)(1+X + X3) =1+ xX? +x? 4+ x* 


{h(X)} = (101110 0) 
{Xh(X)} = (0 101110) 
{x?h(X)} = (0010111) 


Since polynomial multiplication and inner or dot product of 
vectors differ, as indicated in Section 6.4, this code is the null 
space of a matrix H formed of {h(X)} , {Xh(X)} ,and {X*h(X)} 
as vectors with the order of components reversed: 


O01) TsO81 
jee Ds Gi NCC a 0, (8, 2) 
1 12).0":1-0:'6 


It can easily be verified that GHT =0 . This code is equivalent 
to the Hamming (7, 4) code, as can be seen from the fact that 
the columns of H are distinct. 


An alternative specification of a cyclic code can be made in terms 
of the roots, possibly in an extension field, of the generator g(X) 
of the ideal. Assume first that there are no repeated roots. Then 
the following statement uniquely specifies a cyclic code: The 
vector {f(X)} is in the code space if and only if a, , a2 ,..., a 
are roots of f(X) . The relation to the previous specification is 
given by Theorem 6.16. If the minimum function of a; is mj,(X), 
then {f(X)} is a code vector if and only if f(X) is divisible by 
m, (X) , m2(X), ... , m,(X) and hence by their least common 
multiple. Therefore the code is the ideal generated by 


g(X) = LCM(m,(X), m2(X), ... , my(X)) 


Since g(X) must divide X"-1 , a, , a2, ..., ay must all be 
roots of X™- 1 , and hence the order of each a; must divide n. 
Also n can be taken to be the least common multiple of the orders 
of the aj , since then each a; is root of x" - 1 and therefore 
g(X) is a factor of x". 1 by Theorem 6. 16. 

If the roots are given as powers of a single element a of order 
e, thatis, if it is specified that aj wa i | where uj is a given 
integer, then the number of factora and degree of each factor of 
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g(X) can be found from the integers e and u; as follows. 
By Theorem 6. 26, all the roots of m,(X) are contained in the 
A . -q? -q3 
Hy Ese. mae ep ies 
sequence a ,a rete! = SEG » ... , and hence all the roots 
are all the distinct elements in this sequence. The exponents, 
then, are the distinct residues modulo e of uy, uq, usq? 2 


ujq?, ... , and the number of distinct residues is the degree 


rj; of m,(X) . It is quite possible for a * and a? to have the 
same minimum function m;(X) = m;(X) . When all the roots 
mj;(X) and mj(X) are listed, the two lists will coincide. Then 
only one of them is included as a factor of g(X) 


Example: The code in the previous example can be specified by 
stating that every code polynomial must have a as a root, 
where a is any root of 1+X* +X? , Alternatively, suppose 
that it is simply stated that every code polynomial should have 
a asa root, where a is any primitive element of GF(2') 

All the primitive elements of GF(2*) are roots either of 

PaiX* + X*ter 24x + x! , and hence the code is either the 
one in the previous example or the equivalent code generated 
by 1 +X + xX? 

A code for which every code vector has a , a root of 
x3 +X* +1 , and 1 as roots is the code generated by 
Gian cna nem eo ce 1) 

As a less trivial example, let 6 = a% , where a is a primi- 
tive element of GF(2!!), and consider the binary cyclic code that 
has £8, B*, 6%, and B* as roots of all code polynomials. Since 
89 X 23 = 2)? - 1, Bp” = 1. Let m(X) be the minimum function 
of §. Then the roots of m(X) are 


B, B*, B*, BS, B'°, B*? = 87, B18, B5* = BI, BY = BP, BS, BI? (8% = B) 


Therefore, m(X) is the minimum function of £, B?, B? , and 
64, anda polynomial is in the code space if and only if it is 
divisible by m(X). Different choices for a primitive element a 
of GF(2!!) lead to different values of 6 , all of which are roots 
of one of the two polynomials X!! + X? + x7 + x® + x5 +X 41 or 
X11 + X04 xX + X54 X44 X24+1 . The resulting codes are 
both equivalent to the Golay (23, 12) code. 

Let q=2 andlet a bea primitive element of GF(2*) 
Then al5=1 . Consider a code for which a vector {f£(X)} is 
a code vector if and only if a, a*, a3, a*, a5, and a® are 
roots. Let mj(X) denote the minimum function of a! . Then 


a, a2, at, and a® are the roots of m,(X) , and mj,(X) = 


m2 (X) = m,(X) = mg(X) . Similarly, a’, a part, 024 iq? 
are the roots of m,(X) . This can be abbreviated by listing 


only the exponents; 
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1 2 4 8 m, (X) = m2(X) =m,(X) degree 4 
3 6. "EZ 9 m,(X) = m,g(X) degree 4 

5S 0 m,(X) degree 2 

Then 


g(X) = m, (X)m3(X)m, (X) 


and g(X) has degree 10. 

Let q=2 and let a bea primitive element of GF(2°) 
Then a3! = 1 . Consider a code for which {f(X)} is a code 
vector if and only if a, a2, a?, ... , a? are roots of £(X) 


Then, as above, 

1 2 4 8 16 m, (X) 
3) 6 12 24 17 =m;(X)=m,(X) degree 5 
5. 10; 20 9 18 m,(X) ee 
7 #14 28 25 19 my(X) ‘degree 5 

All the elements a, a Pee, iG al° are included among the 


roots of m,(X), m;(X), m,(X), and m,(X), and therefore 


g(X) =m, (X)m,3(X)m, (X)m_.(X) 


m2 (X) = m,(X) = m ,(X) degree 5 


m (X)=my,(X) degree 5 


which has degree 20. 


If it is specified that f(X) must have a; as a root of multi- 
plicity r; , then the minimum function mj(X) of aj; ear ap- 
pear in g(X) repeated rj times. It can be shown that X™ - 1 
has no repeated roots if n and q are relatively prime.* If 
n=q°n, , where n, and q are relatively prime, then 

s 


q 

aay Oe See | 
by Theorem 6.14. Thus X™- 1 always has all its roots re- 
peated the same number of times, q® , where q® is the highest 
power of q that divides n . The value of n can be found for 
repeated roots as follows: Take n, to be the least common mul- 
tiple of the orders of the CLSTHENUS, Gy 4.025, +... .4 Gy . Each 
is a single root of X Sei a) Lat’ 2 be the maximum multi- 
plicity of any root, and s athe smallest integer such that 
Ton q® . Then nenjq 


Two practical ways of finding the minimum function of a given 
field element are illustrated next for the element a>, where a 
is a root of the primitive polynomial X4+X +1 . (See Table 6.1.) 


“In this case X"~ 1 and ite formal derivative nX®-! are rela- 
tively prime, See, for example, Reference 5, page 102, or 


Reference 7, page 80, 
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1. The roots of m,(X) are a3 , a®, al? | and a? , and 


therefore, m,(X) = (X - a3)(x - a®)(x - al”y(x - a9) , 
Multiplication with the aid of Table 6.1 yields m,;(X) = 
Me eae Rt K + 1 

2. It is known that m,(X) has degree 4. Let m(X) =a 
ap + ayX + apX* +a,X7+X* . Substituting a? = (000 1) 
for X, a® =(0011) for X*?, a? =(0101) for X?, 
and d*=(1111) for X* gives 


uf 0 0 0 1 
ao % + ay + a2 : + a, } + F =0 
0 0 1 0 1 
0 1 1 a 1 
or 
ao +12=0 
a, +1=0 
a2 + )-='0 
a, +a2 +a, +120 
and the solution is ay =a, =a, =a,;=1 . Another method 


is given by Albert, Reference 5, Theorem 5. 25. 
8.2, Matrix Description of Cyclic Codes 


The most elementary description by matrices has been illus- 
trated in the previous section. If g(X) =a, +a,X +... + aX” 
is the generator of the code, then {g(X)}, {Xg(X)},..., 
{x®-*"“g(x)} are all code vectors. Thus all the rows of the 
following matrix are code vectors: 


ao ay . i. ap 0 e ere . 0 
0 Cs ree ee ; ar 0 es ‘ 0 
G=|. (8. 3) 
0 05%. 2 Jago aia Racine) 
0 0 . pall ao AY kod ve ar 


Clearly, they are linearly independent, and the rank of G is 
n- r , which is also the dimension of the code, Therefore by 
Theorem 2.9 the row space of G is the code space, 
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In connection with cyclic codes, the following convention will 
beused. The first.n'= k ssymbols, coetticientsror 25. 5 <5 5 
ae -1 , will be taken as parity-check symbole, and the last k 
s : XNn-K- ria sch xh- 


ymbols, coefficients of X™~ F wi 


be taken as information symbols. Thus the identity matrix in 
reduced-echelon form will be placed on the right. 

Every cyclic code can be put in this modified reduced-echelon 
form as follows. Let r;(X) be the remainder after dividing x 
by g(X): 


x? = g(X)q,(X) + 2,(X) 


Then 
Xx? = 4 (X) = g(X)q,(X) 


is a code vector. If these polynomials, for i=n-k , n-ktl, 
., n-1 =, are taken as rows of the generator matrix, then 


G=[-R 1] 


where I, isa kXk identity matrix and R isa kx (n - k) 
matrix whose jth row is the vector of coefficients of Ty-k+j-1'%) 7 
Then by Theorem 3.4 the code is also the null space of the 
matrix 
ay 

H = ik Re] 
The jth row of H! is the vector of coefficients of or hal » even 
fort jeargrerk. 


Example; For the binary cyclic code generated by f(X) = 
Li tke th 28 


Xone Oo a 3 100 
Xie 0 +X 010 
xX? = 0 + x? 001 
x’ 2 g(X) + 1 + xX? Hy = [101 (8. 4) 
bare (lk +x) g(X)+1+X +x? Lei 
X52 (1+X +X?) g(X) + 1+X 110 
x® = (X +X? + X%) g(x) +X +x? 011 
1011000 
q, af 1110100 (8, 5) 
1100010 


O11000 
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The matrix G given here is row equivalent to the matrix given 
in the example on page 139. The code is the same code, not just 
an equivalent code. 

Now consider the dual code that, by Theorem 6.12, is gener- 
ated by 6 (St 1) g(K) Sal = Se) ead + XA 8 eS 
For this generator 


ro(X) = 1 1000 
r,(X) = x 0100 
r2(X) = x 0010 
r3(X) © x3 Hy =}0001 (8. 6) 
r,(X) = 1 +x? +x? 1011 
r,(X)=1+X +x? 11°10 
r,(X) = 3 KS Ke? Onk 7 
1011100 
(apy alla wi aleto) (onshye (8. 7) 
0111001 


The matrices H, and G, differ in having the order of 
columns reversed and the rows reversed, and the same is true 
of G, and Hz, . The rearrangement of rows does not affect 
the row space or null space. The rearrangement of columns 
is a result of the fact that two polynomials multiply to 0 only 
if the dot product of the vectors, with the order of components 
reversed in one of them, is 0. 


Now let us assume that a polynomial f(X) is in the code space 
imandionlwt it"hasr a: 5.295) 2; 4.) Oy 2a soots. Lf 


PEL t+ Ae 
then 
ee COL ee aoe Meee 
and this can be written as a matrix product: 
CA RS re Tr a 


This is a condition exactly equivalent to the condition that a; be 
a root of f(X) . In view of Theorem 6, 16, this is also exactly 
the condition that f(X) be divisible by the minimum function m,(X) 


of aj . The condition that a polynomial have a; , ag, ..., ay 
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as roots is equivalent to the condition that the corresponding 
vector be in the null space of the matrix 


2 n-1 
ai a) canes a) 
2 n-1 
a2 a2 ee a2 
(8. 8) 
2 n-l1 
a a a 
= pe z' 





The set of all polynomials that have a; as a root is the null space 
of the matrix 


(1, a,,+..,5 a; ) (8. 9) 
and since these are exactly the polynomials that are divisible by 
mj(X) of degree m;, they form anideal, which has dimension 
n- mj by Theorem6.11. Since the null space of Matrix 8.9 
has dimension n-m,; , its row space has dimension m; , by 
Theorem 6.11 or Theorem 2.15. Note that the coefficients of the 
code polynomials are in the field GF(q) , but a; is in an exten- 
sion field unless m; = 1 . Elements of the extension field can be 
considered as vectors with mj; Components over the ground field. 
Therefore the row space of the matrix in Equation 8.9 has 
dimension m; over GF(q) . The following example should make 
this clear. 

If aj and a; have the same minimum polynomial m,(X) = m j(X), 
their null spaces are the same, and hence their row spaces are the 
same as spaces over GF(q) . Therefore in forming the matrix H 
in Equation 8.8, only one root need be listed for each irreducible 
factor of g(X) 


Example: Consider again the binary cyclic code for which {£(X)} 


is a code vector if and only if a, a? “oa ROLE, a® are roots of 
f(X) , where a is a root of p(X) =X*+X +1 and therefore is 
a primitive element of GF(2*) . Then 


g(X) = m,; (X)m;(X)m, (X) 


and it is sufficient to require that every f(X) have a, a3, 
and a’ ag roots, Thus the code is the null space of the 
matrix H whose transpose is 
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1 1 
a> a? 
6 10 
a a 
ile 
H' = 
2 1Z 0 1 
at = a = a e 





or, with the vector representation of the field elements given 
in Table 6.1, 


0 10" OF 0) 1000 
0 0001 0 -£ar0 
0 0011 Pr 0 
1 0101 1000 
0 1A) Gua Oa | OTTO 
0 1000 Lal 1:0 
1 O20) 01 1000 
12 1 vO Oat 40 
0 0101 TO) 
1 Nat aoe 1000 
0 1000 0110 
1 0001 Tel aio 
1 LO) 6) Uae f 1308050 
1 OO LS) a G9] 
1 Dalat? ihinO 





Now 
1- X'* = (1 = Xl + Xe eee a eee 
x (1 +0 + X*) (4 oe aes) 


and it is easily verified that if a is a root of HX + X*, then a 


is a root of 1 +X +X? + X3 + x* + X53 and a® is a root of l + X + X® 


Therefore the rank of (1, a, a*,..., a’*y is 4, and the rank 
of (1, a?, a®, ..., (a5)*) is 4, since both a and a? have 
minimum functions of degree 4. The degree of the minimum 


10 


5, however, is 2, and (1, a® , al®, ...,(a*)'% 


function of a 
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should have rank 2. Clearly it does; in Ht above, the last 
column is 0, and the next to last is a duplicate of the previous 
column. 


If it is required that f(X) have a; as a root repeated r, times, 


then f(X) and its first rj 1 formal derivatives * must have a; 
as a root, and therefore if 


£(X) = ag +a,X Bs cocrake 


then 
f(a) = apt ajat... +a,_ya =0 


zZ 


f'(a) =O +a, taz(2a) +... +a,_y(n- Ia =0 


£"(a) = 0 +0 + 2a, +... tap_y(n-1)(n-2)a™ > = 0 


and soon. Thus every code vector must be in the null space of 
the following r; vectors: 


Chea, he year ght Pia | 
ir itn oa elisa Aa 
CAL We SAA OE OAs gees ake | 


and so on. 


8.3. Maximum-Length Sequences 


Consider now the maximum period possible for a shift register 
of m stages, or equivalently for solutions of a difference equation 
corresponding to a polynomial of degree m . The sequence will 
start repeating as soon as the vector stored in the shift register 
repeats, and therefore there must be a distinct vector in the shift 
register for each element in one period of the sequence. Further- 
more, if the shift register contains all 0's, all outputs will also be 
0's. A sequence of length greater than q™ - 1, the number of 
nonzero vectors of length m , would therefore be impossible. 

The existence of such sequences can be shown algebraically as 
follows. Let h(X) be the polynomial of degree m corresponding 
to the feedback connections. Then, by Theorem 7.1, the period of 
the sequences is the smallest n such that h(X) divides We Aly 
By Theorem 6.23, h(X) divides X97 -1!-1 , and hence 
ns a - 1. But if h(X) is a primitive polynomial, h(X) 
divides X"- 1 for no smaller value of n , and therefore the 
period of the sequences is exactly q™ - 1 . Examples of shift- 
register generators that generate maximum-length sequences 


"See, for example, Reference 5, page 102, or Reference 7, page 80. 
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are given in Figures 7.15 and 7.17. 

The set of all possible outputs of such a shift-register, that is, 
the set of all solutions of the corresponding difference equations, 
has dimension m , and therefore there are q™ such solutions. 
One is the sequence of all 0's. Given any other, all hi - 1 
cyclic shifts of it must be solutions also. This is the total number 
of solutions. Therefore any two nonzero solutions differ only in 
that one is a cyclic shift of the other. The set of vectors that are 
the first periods of all the solutions forms an ideal, and hence a 
cyclic code. The one with the most leading 0's must be 
{(xd"-1 ~ 1)/h(x)} 

The vector contained in the shift register consists of m_ suc- 
cessive elements of the sequence. Since the contents of the shift 
register must be different for each element in one period, each 
nonzero vector of m components must appear in m_ successive 
positions of a maximum-length sequence in one and only one place. 
Finally, in the set of all m-component vectors, every field ele- 
ment appears in 1/q of the mq™ positions, that is, in mqm-1 
positions. If the 0 vector is omitted, 0 appears only m(q™-1 =a) 
times. Since every m-component vector appears once and only 
once in a maximum-length sequence, and in this way each element 
of the sequence is counted m times, every nonzero element 
appears in one period of a maximum-length sequence qm-1 times, 


and 0 appears qn! - 1 times. This tells completely the distance 


structure of these codes. 


8.4. Encoding with a k-Stage Shift Register 


Encoding for the (n, k) cyclic code generated by g(X), a poly- 
nomial of degree n-k , can be accomplished by using the shift 
register shown in Figure 7.14, with connections corresponding to 
h(X) = (x™ - 1)/g(X) . The information symbols are stored 
initially in the k storage devices, and then the device is made to 
shift n times. The first k symbols that come out will be the 
information symbols, and the last n- k symbols will be a set of 
check symbols that make the whole n-symbol vector a code vector. 
That this is true follows immediately from Theorem 7. 1. 


Example: For the (7, 4) binary code considered in previous 
examples, g(X) = 1+X + X* and h(X) = (X7 + 1)/g(X) = 
1+X+xX?+X* . The shift register shown in Figure 8.1 can 
be used for encoding. 


ROPER TET) 


Figure 8.1, Shift register for encoding the (7,4) code 
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8.5. Encoding with a Shift Register of n - k Stages 


A code word can be formed by multiplying a polynomial of 
degree k - 1 or less whose coefficients are arbitrary informa- 
tion symbols by g(X) , the generator polynomial of the code, 
This can be mechanized with the linear circuit shown in Figure 
7.2 or the one in Figure 7.3. With this method the information 
symbols do not appear unaltered in the code polynomial, but 
can be recovered from a correct code polynomial by division by 
g(X) , using the circuit in Figure 7.6. 

It is generally simpler and more satisfactory to have the code 
vector consist of the k unaltered information symbols followed 
by n-k check symbols, that is, to have a systematic code. 

This can be accomplished for any cyclic code by the following 
procedure. Let f,(X) be a polynomial in which the k coefficients 
of terms involving X™-*, X®-“, ... , X™°* are arbitrary in- 
formation symbols, and the coefficients of terms of degree less 
than n-k are 0. This corresponds toa vector for which the 
first n - k components are 0, the last k components arbitrary 
information symbols. Then, by the division algorithm (Equation 
6. 4), 


f£)(X) = g(X)q(X) + r(X) 


where r(X) has degree less than n-k , the degree of g(X). 
Then 


fo(X) - r(X) = g(X)q(X) 


and hence {fo(X) - r(X)} is acode vector. Since r(X) has 
degree less than n-k , all its terms of degree n-k or greater 
are 0. Butall the terms of f)(X) of degree less than n-k are 
0. Therefore the high-order terms of f)(X) - r(X) are the in- 
formation symbols unaltered, and the low-order terms are the 
check symbols, -r(X), unaltered. The combined code vector ob- 
tained in this way is identical to the one obtained by the method of 
the previous section if the same information symbols are chosen. 
The remaining problem is to find a way of implementing the 
calculation of the remainder after dividing a polynomial f)(X) by 
g(X) . This can be done with the division circuit shown in Figure 
7.6. The polynomial fo(X) that has information symbols as its 
k high-order coefficients and 0's as its n-k low-order coef- 
ficients is shifted into the circuit, high-order first, until the 
last coefficient is shifted into the low-order position of the shift 
register, This requires a total of n shifts, k for the informa- 
tion symbols and n-k for the low-order O's. Then the re- 
mainder r(X) is in the shift register, and the remainder is the 
additive inverse (negative) of the check symbols, These check 
symbols can then replace the low-order aymbola of {fo (X)} to 
form a code vector, 
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The process can be streamlined by making the modification 
shown in Figure 8.2. This modification results effectively in mul- 
tiplying the symbols automatically by x"-K as they are added into 
the shift register. Then coding can proceed as follows: 


1, Shift the k information symbols into the device shown in 
Figure 8.2 and simultaneously into the communication chan- 
nel. As soonas the k information symbols have entered 
the shift register, the n - k symbols in the register are 
the remainder, that is, the negative of the check symbols. 

2. Disable the feedback circuit in the shift register, for ex- 
ample by gating it at the point shown on the diagram. 

3. Shift the contents of the shift register out, changing the 
signs of the symbols as they come out, and send them into 
the communication channel, These n-k check symbols 
together with the k information symbols make a complete 
code vector. 





n-k 


Figure 8.2. An encoder with automatic premultiplication by X 


A received vector can be checked for parity failures by simply 
entering the entire vector as input to either the circuit in Figure 7.6 
or the one in Figure 8.2, with all storage elements initially set at 
0. The contents after the vector has been entered will be the re- 
mainder after division by g(X) , and therefore will be 0 if and 
only if the vector was a code vector. 

It should be noted that for codes with more check symbols than 
information symbols the method of Section 8.4 would generally be 
preferable, while for codes with fewer check symbols than infor- 
mation symbols this method would generally be more economical. 
Either will give the same coded vector. 


Example: For the (7, 4) binary cyclic code considered in pre- 
vious examples, g(X)=1+X +X? , the equivalent of Figure 
8.2 is shown in Figure 8. 3. 


Output 





Input 


Figure 8.3, An (n = k)+atage encoder for a eyelie (7, 4) code 
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Encoding can also be done by a modification of this method by 
using circuits obtained from the basic division circuit by the trans - 
formation given in Equation 7.30. The transformation can be ap- 
plied to the circuit in Figure 8.2 under both conditions, gate open 
and gate closed, to yield the correct connections in each case. 


Example: The matrices for Figure 8.3 are, for the gate closed, 
0 10 

Tay |LOnOr ie | Gane =a [Te INOS &; Rove {010.01], ee) isnt] 
1G bal 0, 


and for the gate open, 


010 
] = [1] 

pT SOLO. Lal ar Sa ON Or Oem eRe = [00.0 % S= 

000 
If the transformation 

: base Ke 0:0. 1 
Az=|]110], Ate. Oriel 

100 TaaO 


is applied to this circuit, the result is, for the gate closed, 
001 

TieeOMI >. (Os =f0OrO Vi | Ri? «1 10] noe SPEiby, 
010 


and for the gate open, 


000 
T ! 
T's}100|, Ues(O00)] , R' =(110) , S'#[1] 
010 


The resulting circuit is shown in Figure 8. 4. 





Figure 8.4, A circuit equivalent to that of Figure 8,3 
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8.6, Error Detection with Cyclic Codes 


Cyclic codes are extremely well suited for error detection, for 
they can be designed to detect many combinations of likely errors, 
and implementation of both encoding and error-detecting circuits 
is practical. 

In general, for error detection the number of parity-check sym- 
bols will be less than the number of information symbols. Then 
the encoding can be accomplished best using the methods of Sec- 
tion 8.5, which require a shift register with as many stages as 
there are parity-check symbols. The same device can be used for 
detection of a parity-check failure. 

Now consider error-detecting capability. 


Theorem 8.2. No code vector of an (n, k) cyclic code isa 
burst of length n-k orless. Therefore every (n, k) cyclic 
code can detect any burst of length n-k or less. 


Proof: Let {r(X)} bea burst of length n-k or less and sup- 
pose that the code in question is generated by g(X) , a polynomial 
of degree n-k . Let the first nonzero coefficient of r(X) be 
the coefficient of XJ . Then 


r(X) = xJ¢5(X) 


where ro must have degree less than n-k , since {r(X)} isa 
burst of length no greater than n-k . Since g(X) divides 
a , g(X) is not divisible by X , and XJ and g(X) are 
relatively prime. Nowif g(X) is to divide r(X) , it must divide 
ro(X) , which is impossible since g(X) has greater degree than 
ro(X) . Therefore, {r(X)} cannot be a code vector. 

QED 


A high percentage of longer bursts is detected as well: 


Theorem 8.3. The fraction of bursts of length b >n -k that 
x9 undetected is’ q >> “Vitq - 1) if b=n-k+1 and 
hide ke ee 


Proof: Consider bursts of length b starting in the i‘? ana 
ending in the (i+ b- 1) symbols. Each has the form {r(X)} = 
{X'r, (X)} , where r,(X) has degree b-1 . There are q- 1 
choices for the first coefficient, q- 1 for the last, and q choices 
for each coefficient in between, with the result that there are 
(ceest)e qe-2 distinct polynomials r, (X) 

The error is undetected if and only if r,(X) has g(X) asa 
factor. 


r (X) = g(X)Q(X) 


Since g(X) has degree n-k , Q(X) must have degree b-1-(n-k), 
If b- l1l=n-k , then Q(X) is a nonzero constant, and there are 
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q- 1 values it may take. The ratio of undetected bursts to the 
total number of bursts is (q - 1)/(q - 1)? q?-2 = q7(®-k-V iq - 1). 
If b- 1>n-k , Q(X) may have any of the q- 1 nonzero field 
elements as its first coefficient, any nonzero field element as its 
last coefficient, and any of the q field elements for each coefficient 
in between. There are, therefore, (q - 1)*q -1-(n-k)-1 choices 
of Q(X) which give undetected error patterns. The ratio for this 


case is q ‘"~ 


QED 


This error-detecting ability can be combined with other proper- 
ties of specific codes. For example, a Bose-Chaudhuri code of 
arbitrary distance d can be constructed, and it will then be capa- 
ble of detecting any combination of d- 1 or fewer errors or any 
burst of length n-k orless. A Fire code can be constructed 
with the ability to correct any single burst of length b . Sucha 
code is capable of detecting any combination of two bursts of length 
b or less or any single burst of length n-k or less. 


Examples: It is shown in Section 8.7 that a distance-4 Hamming 
binary code can be achieved as a cyclic code. Let us take 

n= 2°. 121023. Then n-k=10+1211 . This code re- 
quires an l1l-stage shift register for coding or error detection. 
It can detect any combination of three errors or any single burst 
of length 11 or less. 

It is shown in Chapter 9 that a Bose-Chaudhuri binary code 
with distance 10 and n = 1023 can be constructed using 41 parity 
checks and therefore a 41]-stage shift register for encoding and 
error detection. It can detect any combination of 9 or fewer 
errors, or any single burst of length 41 or less, and the over- 
whelming majority of all other error patterns. 


8.7. Binary Hamming Codes 


Let a bea primitive element of GF(2™) and consider the null 

space of 
m 
WOOL ee ae a ae 

If the powers of a are represented by column vectors of 1's and 
O's, then every type of nonzero column of length m appears as a 
column of H . Therefore the null space of H is a Hamming 
single-error-correcting code, As a cyclic code it can be char- 
acterized by stating that {f(X)} is a code vector if and only if a 
is a root of {(X) . The minimum function of a is a primitive 
polynomial, and therefore the generator polynomial of this code 
is primitive. Also, any code generated by a primitive polynomial 
p(X) is a Hamming code, 
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Encoding can best be done by the method described in Section 8.5. 


The first step in correcting errors is to calculate for the received 
vector r= {r(X)} the syndrome rH =r(a) . This can be done 
by the method described in Section 7.3. Note that in each case 
high-order coefficients should be processed first, and these are 
information symbols. As was pointed out in Section 5.1, the syn- 
drome will be 0 if there are no errors, and it will match the 
column of H corresponding to the error for any single error. 

If the field elements 1, a, a”, ..., a2 - are considered to 
be numbers designating the columns, then the syndrome rH = r(a) 
is the error-location number. The next problem is to find how 
the error-location number can be translated into useful information 
in a machine. One way would be to put it in a device like the one 
that is described at the beginning of Section 7.3, and shift until 


the vector (1, 0, ..., 0) appears in the device. Note thata 
shift multiplies by a, andthe vector (1, 0, ..., 0) corre-. 
sponds toa =a -! | Thusif the device initially contained a), 
fe 


- 1 - j shifts would be required. But since nigh-or der com- 
ponents are processed first, it is the (2™ - 1 - j) component 
that needs correction. 

The three shift registers, for encoding, parity-check calcula- 
tion, and counting, are all identical. 

Finally consider exactly how a Hamming encoder and error- 
corrector might be constructed. To be specific, consider a 
(15 , 11) code whose generator is the primitive polynomial 
p(x) X*4 XK 4 1°. For comparison, the shift register for en- 
coding is shown in Figure 8.5. 


Fan eat oa 
ChO-ORORO Outer 
Figure 8.5. Encoder for cyclic Hamming (15, 11) code 


The parity-check calculation is accomplished with the device 
shown in Figure 8. 6. 


wwe bh OH 


Figure 8.6. Parity-check calculation circuit for cyclic Hamming 
(15, 11) code 


The entire received vector is entered into this shift register, which 
is shifted once as each symbol enters, Simultaneously the re- 
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ceived vector is stored in some buffer storage, such as a track of 
a magnetic drum. As soon as all the symbols have entered the 
shift register, the information can be read back from the buffer. 
If no parity checks have failed, the shift register contains all 0's 
and no correction is necessary. If the shift register does not con- 
tain all 0's, it is assumed that a single error occurred. For each 
symbol read out of the buffer, the shift register is shifted once 
with no input. The combination (100 0) appears at the time when 
the erroneous symbol comes out of the buffer, and this symbol need 
only be complemented to complete the correction, All this can be 
mechanized with simple logical circuitry. 

The Hamming double-error-detecting single-error-correcting 
code differs from the simple single-error-correcting code in 
having an over-all parity check. Thus it is the null space of 


This is slightly different from the code considered in Section 5.1, 
in that a parity check has been added, but no new symbol has been 
added. Thus one information symbol has been eliminated. For 
this code, {f(X)} is a code vector if and only if a and 1 are roots 
of {(X) . Therefore the generator of the code is 


BOve er Sle e+ Rayer LK exe ee 


The shift register for encoding is shown in Figure 8.7. 


(+) Input 
Loeo-}-O-O-6-1 


Output 


Figure 8.7. Encoder for cyclic Hamming (15, 10) code 


The parity-check calculation is split into two parts. If {xr(X)} 

is the received vector, r(a) is the parity-check information cor- 
responding to the top row of H , and r(1) is the over-all parity 
check. The circuits are shown in Figure 8.8. 


r(a) r(1) 
w— dopo fo) 
Inpu 


Figure 8.8, Shift registers for parity-check calculation for 
eyelic Hamming (15, 10) code 
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The correction is done as follows: 


1. r(a) = r(1) = 0 ; no correction necessary, 
r(1) = 1, r(a) #0; assume a single error and proceed as 
with the single-error-correcting Hamming code. 


3, r(1) =0, r(a) #0; double error at least — turn on error 
alarm, 


It is interesting to note that in this case the encoder and decoder 
are not identical. In fact, a casual glance does not reveal any re- 
lation between them. A method of correction using identical shift 
registers for coding and decoding is described in Section 10.5. 


8.8. Generalized Hamming Codes 


There are several ways of arriving at a generalized Hamming 
code in the framework of this chapter. Two of them are described 
here, and one in Problem 8.5. 

The most natural generalization over GF(q) is formed by 
taking {f(X)} to be a code vector if it is in the null space of 





Bei io. Bose eT 
that is, if and only if B isa ae of f(X) , where a ig 4 a primi- 
tive root of GF(q™) and 6 = : Then, dince at 7) 2/1 |, 
m 
— 
-1 
oe 8. 
and n is the order of 8 , that is, 
Wg ae 
q-1 


as it should be for a perfect generalized Hamming code. 
Theorem 8.4. The null space of H=(1,8,..., 6"), 


n = (q™ - 1)/(q - 1), is a code with minimum distance 3 if 
and only if m is relatively prime to q - 1 


Proof: Since q’ - 1 is divisible by q-1 forall j , 


q=(q-1)s,41 
Therefore 
m 
foes Te ted m-2 
Nal hes gS + q 4 +1 
S(q- ie yt Ble tees ta) tm 
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and n is relatively prime to q- 1 if and only if m is also, 
Now suppose that one column of H is a scalar multiple of another 
column: 


p= ap! (8. 10) 
where a is an element of GF(q) . Then 

psa 
The nonzero field elements must be, by Theorem 6.18, the roots 
of X2°* - 1; and hence must be the first q - 1 powers of, a™ 


Thus 
fa DEH 2 (mys 


for some integer s less than q-1, and 
(q - 1)(i - j) = ns (8. 11) 


But (q - 1) cannot divide s since s<q-1 , andif q-1 is 

relatively prime to n , then i - j must equal 0 and a=l1 

Then no two different columns of H are linearly dependent. On 

the other hand, if q-1 and n are not relatively prime, there is 

a nontrivial solution to Equation 8.11 and hence to Equation 8. 10. 
QED 


let “ae et aye foe tt Poet i be the minimum function for 
6B . Then encoding can be accomplished by the method described 
in Section 8.5. Fora received vector r(X) , the desired parity 
information is r(f) , and this can be calculated by the methods 
of Section 7.3, that is, the device shown in Figure 7.6. If an 
error of b occurs in the component numbered p! , the content 


of the shift register is bp! . A shift in this device corresponds 
to multiplication by 6 . Shifting n -j times results in the 
vector (b, 0, ..., 0) , andno other number of shifts can 


result in 0's in all except the first component because no two 
powers of ® are scalar multiples of each other. Then error 
correction can be accomplished as follows, for an assumption that 
a single error has occurred: 


1. Calculate the parity checks using the shift register shown 
in Figure 7.6 and simultaneously store the received vector 
in a buffer storage, 

2. Read the received vector out of the buffer storage, and as 
each symbol comes out cause one shift of the shift register 
with no input, 

3, When the erroneous symbol comes out of the buffer, all 
except the firat stage of the shift register contain 0's 
The amount of the error ia contained in the first stage. 
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Subtract it from the erroneous symbol, and then read the 
rest of vector from the buffer. 


Another form of modified Hamming code can be formed by taking 
the code to be the null space of 


2 
Dr ak’ epee ice meee ty Bets 


or in other words by taking {f(X)} to be a code vector if and only 
if a and 1 are roots of f(X) , where a is a primitive element of 
GF(q™~“) . This code corrects single errors, since no two 
columns of H can be linearly dependent. It has m_ parity-check 
symbols and qm~t symbols rather than the maximum number 
possible (q™- 1)/(q- 1) . It is shorter by the fraction (q - 1)/q 
approximately. 

If p(X) is a primitive polynomial of degree m- 1 over GF(q) , 
then the generator for this code can be taken to be (1 - X)p(X) = g(X), 
and the encoding can be done as described in Section 8.5. The 
parity-check information r(1) and r(a) may be calculated by the 
methods described in Section 7.3. The circuits will be very closely 
analogous to those shown in Figure 8.8 for the Hamming double- 
error-detecting single-error-correcting code. The error correc- 
tion can be accomplished as follows: 


1, Calculate the parity checks using an(m - 1)-stage shift 
register A to calculate r(a) , anda one-stage shift 
register B to calculate r(1) . Simultaneously store the 
received vector in a buffer storage. 

2. Read the received vector out of the buffer storage, and as 
each symbol comes out cause one shift in shift register A 
with no input. 

3. Test for the condition (a) all stages of shift register A ex- 
cept the first are 0, and simultaneously (b) the first stage of 
A matches the one stage of B, When this condition is met, 
the erroneous symbol has just come out of the buffer. 
Correct it by subtracting from it the contents of register B. 


The method of error correction described in Section 10.5 works 
for this code also. 


8.9. Shortened Cyclic Codes 
Given an (n, k) linear code, it is always possible to form an 
(n -i, k - i) linear code by making the i leading information 


symbols identically 0 and omitting them from code vectors. In the 
case of cyclic codes, this corresponds to omitting the last i rows 
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and columns of the generator matrix, or the last i columns from 
the matrix of parity-check rules. The resulting code is not a cyclic 
code, however, because it is no longer true in every case that the 
vector formed by shifting a code vector cyclically is also a code 
vector. In this book, such a code will be called a shortened cyclic 
code. 


Example: If the leading information symbol is dropped from the 
(7, 4) code in the example in Section 8.2, the resulting (6, 3) 
code has the following generator matrix G and parity-check 
matrix H: 


1072700 TOOsTs 11 
Gre ie Tal eOele0oh05 Hy =) 0. 10001 fl 
TE OVO OF 1 OORT 


Theivectors (2/0 1 1,0°0) , (0'10:1 1 0) , and) 40°00 20"1e) 
are code vectors, but one more cyclic shift results in (100101), 
which is not in the null space of H 


A shortened code has at least as great a minimum distance as 
the code from which it is derived, and it can correct any burst- 
error patterns that the original code could correct. 

Theorem 8.1 states that cyclic codes are ideals in the algebra 
of polynomials modulo ed ge A naturel generalization is to 
codes that are ideals modulo some other polynomial f(X) . Such 
a code is called a pseudo-cyclic code. The following two theorems, 
together with their proofs, show that as classes, the shortened 
cyclic codes and the pseudo-cyclic codes are the same. 


Theorem 8.5. Every pseudo-cyclic code with minimum weight 
greater than 2 is a shortened cyclic code. 


Proof: Let f(X) be a polynomial of degree n and let I be an 
ideal in the algebra of polynomials modulo f(X) , that is, a pseudo- 
cyclic code. Then, by Theorems 6.9 and 6.10, there is a monic 
polynomial g(X) that is the generator of the ideal, anda vector 
(ap , a, » --. » Aan-]) is in the ideal if and only if a(X) = 
ap +a;X +... + ay_1]X""! is divisible by g(X). Let n' be the 
smallest integer for which x" - 1 is divisible by g(X) . Then 
n' >n , for otherwise (x?! - 1} would be a code vector of weight 
2. Then g(X) generates a cyclic code of length n' , and in this 
code a vector (a9, a , «+. , Apt_y) is a code vector if and only 
if a(X) = ap +a;X +... + @py1.7X"~! is divisible by g(X) . If 
this cyclic code is shortened by including only those code vectors 
for which a, , @yyzr s+ » Oyt.y are all 0 and dropping those 
components, the code vectors are exactly those of the pseudo- 


cyclic code, 
QED 
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Theorem 8.6. Every shortened cyclic code is a pseudo-cyclic 
code. 


Proof: Suppose that g(X) generates a cyclic code of length n'!. 
and consider the shortened cyclic code of length n obtained from 
this code. By Equation 6. 4, 


X" = g(X)q(X) + r(X) (8. 12) 


where r(X) has degree less than the degree of g(X) . Let 
f(X) = X" - r(X) , and consider the algebra of polynomials modulo 
f(X) . It can be seen from Equation 8.12 that g(X) divides f(X) . 
By Theorem 6.10, g(X) generates an ideal, and hence a pseudo- 
cyclic code, that can be seen to be the same as the shortened 
cyclic code. 

QED 


NOTES 


The study of cyclic codes originated with Prange. pnee Many references on 


specific cyclic codes are cited in the next three chapters, anda number of 
the ideas presented in this chapter come directly or indirectly from those 
sources. The equivalence of cyclic codes with ideals was noticed independ- 
ently by Prange and the author. 87 The method of encoding using a k-stage 
shift register is essentially equivalent to the idea of using shift-register- 
generated sequences as code vectors, and appears in References 54 and 
92. The encoder that uses an (n - k)-stage shift register was found by the 
author, 87 and the fact that it can be modified for use with circuits equivalent 
to the division circuit was discovered by Meggitt and Abramson. Theorem 
8.3 and the implications of Theorem 8. 2 with respect to error-detection by 
cyclic codes were pointed out by D.T. Brown.'® An application of these ideas 
to a practical problem is described in Reference 39. Green and San Soucie™ 
proposed the use of maximal length sequences for error-correction, and 
Zierler'*> pointed out their connection with Reed-Muller codes. 

Hamming codes have been previously studied by Abramson, - Elspas,”? 
and Stern and Friedland!®? 
circuit viewpoint and arrive at a different way of mechanizing the code de- 
scribed in Problem 8.5. In their system, the coding is not ''systematic, "' 
that is, the information symbols do not appear unchanged in the coded vector. 


This necessitates the use of a ''decoding filter'' in addition to error correction. 


There does not seem to be any fundamental reason why the approach used in 
this chapter should lead to a better decoding method in every case; this state- 
ment merely underlines Huffman's principle™ that two viewpoints are better 
than one. 

Section 8.9 is based on some work of S. S. Shatz. 


as cyclic codes. Stern and Friedland use a linear- 
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PROBLEMS 


8.1. A cyclic code is generated by g(X) = X°+X7+ Dara Gerno | 


a. Show that its length is 15. 

b. Find the generator matrix and parity-check matrix in modified- 
echelon canonical form for this code. 

c. Devise alinear switching circuit for encoding using k=7 stages 
and one using n-k= 8 stages. 

d. Show that a, a@ , @, and a’ are roots of g(X) , where a 
is a root of X*+X+1 . (Compare Table 6.1.) s 

e. Devise circuits for calculating r(1), r(a) , and r(a*) for any re- 
ceived vector {r(X)} 


8.2. Show that the cyclic code of length n generated by g(X) has mini- 
mum weight at least 3 if n is the smallest integer for which g(X) divides 
Moree 

8.3. Suppose that g(X) generates a cyclic code of length n over GF(q) 
and suppose that n is not divisible by q°. Show that a vector consisting 
of all 1's is a code vector if and only if g(X) is not divisible by X - 1 


8.4. Let g*(X) denote the reciprocal polynomial of g(X) 


a. Show that codes generated by g(X) and g*(X) are equivalent. 
b. Show that if g(X) = g*(X) , the code generated by g(X) has the 
property that if v =(a, a, ..., ay,-1) is a code vector, so is 
v¥ = (an, aq-2) +++ + 80) 
8.5. Leta bea primitive element of GF(q™) and let n= (gree aye 
(q - 1) . Show that a” is @ primitive root of GF(q) . Consider the 
matrix ; 


Balt. eee eee 
and the code that is its null space. (The null space of H Ry shortened 
cyclic code, since a" #1. It is acyclic code of length q. -1 in 


which only the n lowest-order components are used.) Show that the null 
space of H has minimum distance at least 3, Devise an m-stage shift 
register for encoding. Devise a system similar to those given in Section 
8.8 for decoding and show the required shift-register circuits. 


Chapter 9 


BOSE-CHAUDHURI CODES 


The codes described in this chapter are a remarkable generali- 
zation of Hamming codes for correcting multiple errors. They are 
as a class the best of the known constructive (that is, nonrandom) 
codes for channels in which errors affect successive symbols 
independently. 


9.1. Definition 


The Bose-Chaudhuri codes are cyclic codes that are best defined 
in terms of the roots of the generator polynomial. Symbols are 
assumed to be elements of GF(q). Let m, be any integer and a 
be any element of GF(q™). Then the code consisting of all vectors 
{£(X)} over GF(q) for which 

m pe a ea a m +2 m +d-2 
° ° ° ° 
a » a + 1& Pe ae es tae 
are roots of f(X) is a Bose-Chaudhuri code. 
pal interest are m, = 0 and mg = l. 

The length of the code is the least common multiple of the orders 
of the roots. Except for the trivial case when only one root a °? 
is specified, the length n of the code is the order e of a, for 


n n 

m ve gue | m +l mntn 
fo) ° ° ° 
a =a acl) sand. Vd =G = ] 


and therefore a = 1, e divides n, and n could be no less than 
e, the order of a. On the other hand, if a” =i (a) © =15560 
that the order of every element a) divides e. Then n is no greater 
than e, and hence n=e, 

The number of parity-check symbols and the number of infor- 
mation symbols can be found by the method given in Section 8.1. 
The minimum distance is given by the following theorem: 


The cases of princi- 


Theorem 9.1. The Bose-Chaudhuri code for which {f(X)} is 
a code vector if and only if f(X) has 
m TH) tk m td-2 
fe) fo) ° 
a eae eOcie eK” 
as roots has minimum distance at least d, 


Proof: As indicated in Section 8,2, this definition of a Bose- 
Chaudhuri code is equivalent to the statement that the code is the 
null space of the matrix 
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Consider the determinant of any set of d - 1 distinct columns of H 
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and this is a van der Monde determinant: 


1 1 1 
X, x. x. 
xt xe x 
= co (X,- X) (9.3) 
" i>j 
a a eae xs! 





Equation 9. 3 can be verified by direct calculation or in the following 
way. (1) If x; = X., the determinant is 0; therefore X. - X. is a 
factor of the left side for all i and j, and consequently the right 
side must divide the left side. (2) Since both sides are polynomials 
of the same degree, they must differ by a constant factor. (3) The 
constant factor must be 1, since the coefficient of 1X, Shon a 
is the same on both sides. Thus as long as no two culumese are ; 
identical, the determinant D is certainly not 0, and hence no com- 
bination of d~1 or fewer columns of H is linearly dependent. By 
Corollary 3,2, the code that is the null space of H has minimum 
distance at least d. QED 


9.2. Binary Codes 


The most important Bose-Chaudhuri codes are obtained by letting 

a be a primitive element of GF(2™) and letting m, = 1, and d = 
2t+1. Then {£(X)} is a code vector if and only if 
2 3 Zt 

og 4 ANG Sx a 
are roots of f(X). However, every even power of a isa root of 
the same minimum function as some previous odd power of a. 
i tad eharnpie, if m,(X) denotes the minimum function of @, then 
a” and a~ are “re ts of m, (X), a° is a root of m, (X), a® isa 
root of m)(X), a is a root of m_(X), and so forth. Therefore 
an equivalent statement is that {4(X)} is a code vector if and only 
if 

Gcice aes gt t 
are roots of f(X). Thus the generator of the code is 


g(X) = LOM(m, (X), m,(X),..., My 1 (X)) 
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and each m;(X) has degree no greater than m by Theorems 6.16 
and 6.24. Therefore g(X) has degree at most mt, and the code 
has at most mt parity checks. These results can be summarized: 


Theorem 9.2. For any m andt there is a Bose~Chaudhuri 
binary code of length 2™ - 1 which corrects all combinations 
of t or fewer errors and has no more than mt parity-check 
symbols. 


All Bose- Chaudhuri codes of this type with length no greater than 
255 are listedin Table 9.1, with the actual number of parity-check 
symbols indicated. A graph showing the rate versus error-correcting 
ability for some longer codes is shown in Figure 9.1. If the ratio 
t/n is kept fixed, the rate k/n approaches 0 as n becomes very 
large. This appears to be true in Figure 9.1, and is in fact proved 
in Reference 87. The Varsharmov-Gilbert bound shows that it is 
possible to do better than this. It may be that these Bose-Chaudhuri 
codes actually do not have as large a minimum distance as is possible 
for long codes of the same length and same number of parity checks, 
or it may be that these codes are actually better than we have been 
able to demonstrate. All the codes of length 15 or less are opti- 
mum, ®’ and all the double-error-correcting codes are quasi- perfect 
and hence optimum,» Also, Figure 9.1 shows that codes even of 
length 1023 are approximately at the Varsharmov-Gilbert bound and 
hence are certainly good. Any nonoptimum behavior these codes 
may have occurs only in codes so long that there is no hope of dem- 


onstrating it except by analysis. 
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Figure 9,1, Error-correcting ability of some Bose-Chaudhuri codes 
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Table 9.1. Bose-Chaudhuri Codes Generated by Primitive Elements 
of Order Less than 2° 


n k t n k t n k ue n k t 
7 4 1 63 LG... 19h L27 ee oe 255.75 1237 ‘19 
155 gid i 10 3 Sx 3k VHS. (21 
q/ 2 he LS 255 247 1 1O%— 22 
5 3 127 L206 1 239 re 99 23 
31 26 1 TT3 2 231 3 91 25 
21 a 106 i} 223 4 ST ~26 
16 bs) 99 4 215 5 19) SAC 
ll 5 92 5 207 6 71 29 
6 7 85 6 199 7 63° 30 
63 57 1 78 7 191 8 Shoes 
51 7 LE 9 187 9 47 42 
45 3 64 10 79, 10 45 43 
39 4 By eae T7t 1 37 45 
36 5 50 13 Dex jaa WA 29 47 
30 6 43 14 PES" 3 Zi 55 
24 7 36 «15 147 14 T5759 
LS 20 co) 21 139" 15 97 Tbs 
Ze. 23 131 18 


Examples: The last two examples on pages 140 and 141 of Chapter 8 
are binary Bose-~Chaudhuri codes. The latter one is defined by 

the specification that {f(X)} is a code vector if and only if a, 

a ,..., a are roots of f{(X), where a is a primitive element 

of GF(25). Then g(X) is shown to have degree 20, so that this 

code, which has minimum distance 11 and is capable of correcting 
all patterns of 5 or fewer errors, has length 2 ie (i= Bilin rex 
quires 20 parity-check symbols and therefore has 11 information 
symbols, 

The other code, that is, the first code on pages 140 and 141 of 
Chapter 8, is used for a detailed illustration ofthe error-correction 
procedures described later in the chapter, so that it is described. 
in more detail here. For it, {f(X)} is a code vector if and only 
if a, a,..., a° are roots of f{(X), where a is a primitive root 
of GF(2*), The length of the code is 2 - 1 = 15. It was found 
that 

e(X) = m, (X) m, (X) m_(x) 


If a is taken to be a root of X* +X +1, as in Table 6, 1, then 
m, (%) = x44+x4 1, and it can be verified that m , (X) = 


xt + X3 +X? +X+1 and m (X) = X*? +X+1. Thus 
g(X) (4x4 xt(l4 x4 x? + X93 + X*)(1 + X + X?) 
=14X+xX* +x* 4+4x54x%4 x10 
(x + 1)/g(X) = 1+ X44 X24 x?® 


h(X) 
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Other interesting codes can be found by taking a to be a nonprim- 
itive root of GF(2™) and taking m, = 1. , 
Example: Let a be the cube ofa primitive element,of GF(2°). 


Then a has order 21. If the minimum function of a is denoted 


m,(X), then a? = 1, and 


a, a’, a" 5, a>, al® g34 = a! are roots of m, (X), degree 6 


Fe ts are roots of m,(X), degree 3 


and therefore 
g(X) = m,(X) m, (X) degree 9 


has a, a”, a®, and at as roots, and the code generated by g(X) 
is a Bose-Chaudhuri code that corrects all double errors, It 
has n= 21, n- k=9, and therefore k = 12. 


All nontrivial codes of this type of length less than 75 are listed 
in Table 9.2. The (21,12), and (73,46) are codes that have been 
studied by Prange?”’*%also. The (23,12) code is the Golay code 
(see Section 5.3 and Reference 91). It is interesting to note that 
this code actually corrects all triple errors, but the method of 
estimating distance for Bose-Chaudhuri codes indicates only that 
it will correct all double and single errors. This is the only known 
example where this method does not give the correct minimum 
rather than only a lower bound, 

Finally, all the codes described in this section have a minimum 
distance shown to be 2t + 1 for some t. The distance can be in- 
creased to 2t + 2 by including 1 as a root. The minimum function 
of 1 is X - 1, and hence this adds one parity check, which can 
easily be seen to be simply a parity check on all symbols. 


Table 9.2. Some Binary Bose-Chaudhuri Codes Generated by 
Nonprimitive Elements 


n k t n k t n k t 
21 12 72 45 Td 4 65 41 2 
6 3 7 { 29 3 
4 4 -) 10 1 5 
23 12 2 47 24 2 5 6 
25 5 2 49 7 3 69 36 2 
2% a 4 4 10 14 vf 
33 13 2 51 35 2 3 Vuk 
35 ll 2 27 4 71 36 3 
8 $ 19 5 ig 55 2 
a 7 ll 8 46 4 
39 15 3 9 9 ay 5 
3 6 55 15 2 28 6 
43 15 3 5 5 19 8 
45 29 2 57 21 2 10 12 
23 5 5 9 
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9.3. The Reed-Solomon Codes 


The special case m = l, m, = 1, is also of special importance, 
Let a be an element of GF(q), and let n be the order of a. (If 
a is primitive, n is q- 1, the largest possible value.) Let {£(X)} 
be a code vector if and only if 
eo eo 
are roots of f(X), The minimum function of a is simply X - o, 
and thus nek 
g(X) = (X= a)(X- 07)... (X- a) 
and g(X) has degree d - 1, and the result is a code with n symbols, 
d- 1 parity-check symbols, and minimum distance d, 
Reed and Solomon have described the following code: Let a be 
a primitive element of GF(q). The order of a is n=q-1. Let 
Ao» 4] » e+e » apy be information symbols and form the polynomial 


' k-1 
11.9 a, taxXt... ta, _ Xx 
Then the code vector is 
(F(1), Fla), F(a?),..., Plat?) (9.4) 


that is, the value of the polynomial for all powers of a, or all non- 
zero elements of GF(q). 

Consider the polynomial that has the components of the vector in 
Equation 9.4 as coefficients; 


£(X) n-1 


u 


F(1) + F(a) X + F(a’) x*, .. + F(at”4y x 


alt x4 x4... + x84) 


4a (1 + aX a®x? 4. 2.4 (axy974 


2 -2 
ta (l+a’X+tatx? +... 4 (a2xy)T% 


il 


k- k-1 k-1 -2 
+h te Bale OR ate x)2"*y 


Note that all the nonzero elements of GF(q) are roots of 


roa | os 
fo xt? 2 (te M4 ROMs, eRe 


and therefore all the glements of GF(q) except 1 are roots o 
1+X+X? ...4X9°, The value ofl +141? +,.,..4 17°, 
isq-1, or-~1, It follows that 





bose-chaudhuri codes 169 
fh) a= a, 
-1 
f(a) = -a, 
=-2 
fais). -a, 
~(k-1), _ 
f(a k= PMs 


and for q-22=j>k-1, f(a”) = 0. But since Py =l, a? = 

q~ 8» and hence f(a’) = 0 for i=1, 2,...,q-1-k. Thus 
this is a Bose-Chaudhuri code for m=1, m_ = 1, as described at 
the beginning of this section. The code lengthis n=q- 1, the 
number of check symbols is n- k, and the minimum distance at 
leastq- k=n-k+1. (See Problem 9.3.) 

These codes are useful for correction of bursts of errors (see 

Section 10.7). 


9.4. An Error-Correction Procedure 


An error-correction procedure is described here for an arbi- 
trary Bose-Chaudhuri code as described in Section 9.1. It will 
correct any combination of t or fewer errors if d= 2t+ 1. 

The first step in deriving an error-correction procedure is to 
describe what information the parity checks, which are the syn- 
drome, give about the errors. Suppose that a code vector {£(x)} 
is transmitted, and errors occur which result ina received vec- 
tor {f(X) + e(X)}. Then, consider the results of substituting 
ao, aint amoret- I in the polynomial f(X) + e(X). Since 
f{(X) is a code vector, and therefore has these elements as roots, 
the result is etary, attr, PATA elato tae 

The error pattern {e(X)} can be described by a list of values 
and locations of its nonzero components. The location will be | 
given in terms of an error-location number, which is simply a)” 
for the jth symbol, Thus each nonzero component of {e(X)} is 
described by a pair of field elements, Y, (the value of the com- 

i 
ponent) and Xj (the error-location number); Y; is an element of 
GF(q) and X; an element of GF(q™). If v errors occur, there 
are v nonzero components of {e(X)}, and hence v pairs (Xj, Y;) 
are required to describe the errors, 

Then in terms of the pairs (Xi, Y))» 


e(@) " ) x, x) " s) (9. 5) 
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and the values of Sj = e(a’) are given by parity-check calculations 
for m, Sj Sm, + 2t - 1. Note that 


\qd , — ‘ 
Le J “4 q yJD _ Jame 
eo" * Oe x) »¥ or, > * Siiay £26) 


by Theorems 6, 14 and 6.18. 

There is a simplification in the binary case. Since Y; is not 0, 
it must be 1, The location of the error is all one needs to know 
in order to correct it, and thus the error pattern is described 
completely by a list of error-location numbers. 

The 2t quantities Si» m,=j= m, + 2t- 1, are calculated 
from the received vector, and in order to correct the errors, the 
pair (Y,,X,) must be found for each of the t or fewer errors. The 
known and ‘the desired quantities are related by the 2t equations 


ae > ee nis psn 6 2e4 
j : a ° ° 
i 
and any method of solving the se equations is the basis for an error- 
correction procedure, 

The equations are nonlinear, and there appears to be no hope of 
a direct solution. There are only a finite number of possible 
solutions, and the correct solution could be found by simply trying 
all possible solutions. In interesting cases, however, there are 
simply too many possible solutions for this to be an effective 
method. There is, however, an effective compromise, 

Suppose that v = t errors actually occur. These are described 
by v pairs (Y,, X,), for which neither Y, nor X, is 0. In order to 
make a total of t pairs (Y5> X,), let us add t -*v pairs of 0's 
that is, 


xX, = Y, =0 fory SiS 4 


Then let the equation 


(X= UK, ~ X) 6. (K+ XM) sop- a, XH... te, a eee ee: 


(9. 7) 
define the quantities 0,» T,5+++,s 0,. These are the elementary 
Symmetric functions. Then if X; is substituted for X in Equation 
9.7, both sides are 0. This is also true if both sides are multi- 
plied by Y;Xq. Therefore, for each j and each i, 


t-1 


SORT, jt+l t-l. j+t-1 tojtt\ 
YX o, YX or te aieie ott Y,(-1) x; ov, + ¥,(-1) x; = 0 (9.8) 
Summing these equations for 1Si =< t and substituting from 
Equation 9.5 yield 
t-1 t 
By Sa Mee ee ere Baten + (1) Bi, "9 (9.9) 
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which must hold for all j. Since S. is found from the parity- check 
calculations for m,S= j= m, +2t- 1, asetof t equations in 
which all the S, are known can be found: j = m, in the first, and 
j=m,+t- 1 ih the last. 

Now an outline of a tentative decoding procedure can be given. 
(It must be modified slightly — it will not always work exactly as 
itis.) (1) Solve the set of t Equations 9.9 (m, =A ij m,+t- 1) 
for the values of Coa pre ace 9 Cee (2) Substitute these in the 
right-hand side of Equation 9.7, and substitute in Equation 9.7 all 
the nonzero elements of GF(q™). Those that are roots are the 
values of X. for errors. Their order is clearly immaterial, 

(3) Substitute the v nonzero values of x; found in (2) into the 
first v Equations 9.5, and solve for the corresponding Y;. (This 
step is unnecessary in the binary case.) With knowledge of all 
the pairs (Y;> Xj), the errors can be corrected. It remains to be 
shown that Equations 9.9 and 9.5 can be solved. 

Equations 9.5 are 


fo) fo) fo) 
ane sted ae = 5 
¥, x, + Y, x + pry m., 
m tl m +l m +1 
Yew ae NER PS tenet YX) +8 4 
* (9. 10) 
m +vl 
m+ v-1 mty-1 YX ° =5s : 
Pa m tv- 
pS x, + Y, x, voy a 
The determinant of the coefficients of the Y's is 
il m ™. 
° 
x, X, aus 
m tl m+ 1 m+ 1 
xX, x, eee xX, 
m tv-1 m,+v=1 m +v-l 
x, x, cee xX 
1 i} Scerasel a 
m, m, m, xX, 2, Se etree § 
7 X, x, sie a x, : x 
x vel oo) x") 
1 2 v 
(9.11) 
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and the determinant on the right is a Van der Monde determinant, 
Equation 9.3. Therefore the right-hand side is not 0 as long as all 
the x; are distinct and nonzero, which is clearly the case here. 
Consequently the v Equations 9.10 are linearly independent and can 
be solved for the v unknowns Y, SPN eae SP atteren ey ox 
X,, have been found. : " Be sau 

“The question of whether or not the Equations 9.9 can be solved is 
answered by the following theorem: 


Theorem 9.3. The matrix 


Ss Ss Adare Ss 
m, m,+1 m,tt-1 
M = Ss 
m,+1 Sin,+2 cap lat Sm tt (rE) 
Ss S Seen 
m,+t-1 m,+t Sm, +2t-2 


is nonsingular if the quantities S; are formed from exactly t 


nonzero distinct pairs (Y;, Xj). This matrix M is singular if it 
is formed from fewer than t nonzero pairs (Yj, Xj). 


Proof: It may be checked by comparing with Equations 9.5 that 





ae 

1 1 1 Y x aks 0 x... xm 

1 | af 1 
™o t= 

ks: A ae x, es A 2 0 x. ae 

tl tel ‘i st 

x” x x 0 0 Y t-# 

‘ : X Xx, 

(9. 13) 


The matrix M is nonsingular if and only if each of the matrices on 
the right side of Equation 9.13 is nonsingular. The first and last 
are Van der Monde matrices, and Equation 9.2 shows that they are 
nonsingular if and only if x, X_,..., X_ are distinct. The middle 
factor is a diagonal matrix er is singulae if and only if each of the 
x, and oy is nonzero, (Note that because of the way they were 
defined, Xj=C ifand only if Yj = 0, so that the case mg = 0 is no 
exception.) Thus M is nonsingular if and only if the pairs (Yj, Xj) 
are nonzero and distinct, QED 


If the unknowns in Equation 9.9 are considered to be (- 1) ms o., 
the matrix of coefficients is the matrix M in Equation 9,12, Then 
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Theorem 9.3 implies that these equations are nonsingular and 
therefore can be solved if exactly t errors have occurred, but the 
equations are linearly dependent if fewer than t errors occurred. 
However in the latter case, o, = 0, either the first or last equation 
can be omitted, and Theorem 9.3 applied to the set of equations 
with one fewer unknowns. The process can be repeated until a set 
of equations is found which can be solved. 

The error-correction procedure is outlined as follows; 


1. Calculate the quantities S., m_= j= m_+2t- 1 from the 
received vector. This amounts to a parity-check calculation. 

2. Determine the maximum number of successive equations that 
are linearly independent. This is the number v of errors that 


actually occurred. 
3; Set re 7 v2’ ines i all equal to 0 and solve the first v 
equations oie. i poe ot 5 if 
4, Substitute ack? of the nonzero elements of GF(q es) in the 
polynomial 


Oe Gat Re ERS: (9. 14) 


The roots are the error-location numbers x 3 x, ag AS Xy- 

5. (This step is unnecessary inthe binary case.) Substitute the 
error-location numbers found in Step 4 into the first vy Equations 
9.5 and solve for the corresponding values of Y,. The determinant 
of the matrix of coefficients has the same general form as Equation 
9.2 and is therefore not 0. Thus these equations are linearly inde- 
pendent. Knowledge of the values of x, and Y; is sufficient for 
correction. 


Example: The binary Bose~Chaudhuri (15.5) code that corrects 
all combinations of three or fewer errors was considered in the 
previous example. Now veppe ee that two errors occur, in the 
positions corresponding to a and a°, Then the parity- check 
calculation for the received vector {r(X)} gives (from Table 6. 1) 


S. = r(a) = (1111) = a” 


S, = rla) = (110i) = (9. 15) 
S, = r(a5 ) = (1110) =a 
and 
Ss = 8S = a = (0102) 
2 1 
S = S = a? = (0001) (9. 16) 
gs = S’ «= a= (0111) 
6 5 


Equations 9,9 become 
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ao t+a’s talc = a and Equations 9.9 become 
. 2 ! 7 12 6 eis 
Wo, talc +a%o, =a (9. 17) Cp a ae 
12 6 ys ey 
ig eat ao) ad ae SR Sige tee (9. 20) 
: : Go +e. + alta. = a* 
Multiplying the first equation by a® = a7, the second by a’ = a, : e : 
and the third by a® = a~’° yields Mutliplying the first by a? = a°, the second by a? = a~!, and 
a®o, poet” SG) =) eet the third by a = a/* yields 
2 x 
6 ee 
ao, + ao, to, = a? ag, +a°o to, =a 
9 Le) ee 
Ga. tee Ag Sis ee enres, ee 
ae Vt 
7 13 a 
Adding the first equation to each of the others then gives two ae a 1 
equations with ¢ eliminated: and adding the first to each of the last two gives 
(0101) 0, +(L110)o, = (1010) or vo, + ao ace (1100), +(0110)¢, = (0001), or ato tac, =a? 
: (9. 18) (9. 21) 


a3 


é = Lys es 
(L001)o, +(1000)e, = (1011) or ata +o, eee (1001) m, + (1000), (0011), or a ee 


Again these are dependent, so that fewer than three errors must 
have occurred. Setting o, = 0 gives oc = a3, and v, is again 


easily found to be a’. e error-location numbers satisfy 


These equations differ only by a factor a5, and hence the latter 
is dependent on the former. Therefore the last of the original 
three of Equations 9.16 must have been dependent on the first 


two, and there must have been only two errors. Setting o, =0 KP tral? Xtal? -5..0 
in Equations 9.18 gives al°o_ = o8, or v, = a3. From any ’ Ye 
of Bavatione’9. 17) ¢) 46 found to ‘bea? , “and the error: location as before, and the error locations are the two roots a3 and a. 
Mmunberel are Gots 2 The error quantities Y; are found from Equations 9.5, 
x? + of X + al? = 0 (9. 19) 743,20 2 5, or a?¥, + an ¥, = a’ 
It is easily verified that the elements a® and a! , and only these, % x? 4+ ¥, x? =S, or oY +2 y = o?? 
satisfy Equation 9.19. Since this is a binary code, knowledge : : 
of the error locations alone suffices for error correction — the and these equations can be solved easily to give Y =a! and 
erroneous symbols simply need to be changed. Y =a’, : 
As a second example, consider a Reed-Solomon type code . s : 
Oven the tela GF(2*), using the representation of the field given 9.5. An Alternative Error-Correction Procedure for Binary Codes 
in Table 6.1. Suppose that an error equal to a’ occurs in the The error-correction procedure of this section has possible ad- 
location corresponding to the location a? and an error a’! in the vantages for the binary case, but apparently cannot be generalized. 
location corresponding to a'°. Then For the binary case, the Y,, which cannot be 0, must be 1. 
S = ad +a! al = (1101) = a Bh j 
= . 2 
S = dt a +g a = (1111) 2 a* o cong 7. 28) 
Bre 11 30 _ Be A The S; are in this case the power-sum symmetric functions.* 
#, EE Thus the parity checks give the first t odd power-sum symmetric 
§. = clial2 terol? alee (10 1D) at? functions. The elementary symmetric functions o; are related to 
ry = dalS +a! a® = (1001) = al the power-sum symmetric functions 5; by Newton's identities:* 
5 
S =.a'g!* + at al = (1001) a a! 


Co 


“See, for example, References 82, 99, and 112, 
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n MW 
! 
a 
iT 
o 


Pups on ct 20. © =. 6 
ya 2 
~~ o.e +8Si¢..6 3a: =.0 
reek Ese 


+40, = 0 (9. 23) 


is) 


A Nn 


- 5,5 + So, - So 


» 


3 


S.o, + So, - S.9, +Sio, - 5o, S10) 


n 
1 


5 
i, and 0° forth 


If it is possible to solve Newton's identities for the elementary 
symmetric functions o;, the error-location numbers can be found 
as follows. The error-location numbers must satisfy the equa- 
tion 


(X, - X)(K,- X). 2. (K- X) sa, -o ee (aay bea! 


i. t-1 
(Ge) 
Equation 9.7 can be solved effectively by merely substituting each 
of the n=2~ - 1 field elements into the equation. For each symbol 


in the received vector, the corresponding GF(2™) element is sub- 
stituted in the equation, If the equation is satisfied, this symbol is 
wrong and must be changed. If the equation is not satisfied, the 
symbol is correct. 

The proof that it is indeed possible to solve for the elementary 
symmetric functions from the power-sum symmetric functions is 
given by the following theorem:* 


Theorem 9.4. The t xt matrix 


1 0 0 0 0 | 

‘ S, 1 0 — 

4 s, Ss, Ss, 0 
M.*= . ° . . 


S 





2t-4 Ries $566 2, ae S.3 
So t-2 $34.3 Mota 54.8 vicoed Peek i 


is nonsingular if the power-sum symmetric functions S: are 
power sums of t or t- 1 distinct field elements, and ‘is singu- 
lar if the 8; are power sums of fewer than t~- 1 distinct field 
elements, 


The proof requires the following two lemmas; 


Lemma 9.5. If the Sj are power sums of vS t- 2 distinct 
field elements, My is singular. 





*Similar results for a real field appear, for example in Reference 42, 
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Proof: 
0 0 
1 0 
M, a, = 
He 0 


by Newton's identities, Equation 9.23, and thus M,> must be 
singular. QED 


Lemma 9.6. If the S; are power sums of t indeterminants 
x ears Xs then the determinant 


|M,| = T] (X, + X)) 
j<i 


Proof: If X, = X., all of the power sums contain two identical 
terms, which cancel because the field has characteristic 2. Then 
it is just as if there were no more than t - 2 distinct elements used 
in forming the power sums, and, by Lemma 9.5, the determinant 
is 0. Therefore, X, - Xj is a factor of the determinant for all i 
and j, and the left-hand side must be divisible by the right-hand side. 
The left-hand side is homogeneous of degree t(t - 1)/2, the same as 
the right-hand side, and therefore they must differ at most by a 
constant factor. 

To determine the constant factor, a single special case suffices. 
If t is odd, let the X; be the roots of the equation 


x'-1=0 
Then 

Dae 2 4,-5.0 if j # 0 modulo t 

= 1 if j =0 modulo t 

There is exactly one 1 in each row and each column, and it fol- 
lows that | M, | = 1 inthis case, For t even, letting the X; be 
all of the roots of the equation 

x'. xX = 0 


gives the same result, The constant factor, which could be only 
0 or 1, must be 1, QED 


Now Theorem 9.4 follows from the fact that if the determinant 
|M,| is 0 it must be that some X, @ X;, Since all of the nonzero 
X; are diatinet, Xj x) « 0, and there are fewer than t - 1 
errors, QED 
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If there are actually t - 1 errors, it can be seen from Newton's 
identities (Equation 9.23), Cramer's rule, and Theorem 9. 4 that 
the solution for the c's will yield we 0. The corresponding poly- 
nomial equation will have O as one root. 

Now review the error-correcting procedure. The t-error- 
correcting Bose-Chaudhuri codes give, as the parity checks on 
received vectors, the odd-power-sum symmetric functions up to 
S241], and the intermediate even functions can be calculated simply 
from these. If it is assumed that no more than t errors occur, 
then by Theorem 9.4 either it is possible to solve for the error- 
location numbers or there are t - 2 or fewer errors. In the latter 
case, 0, ) =o, = 0, and two equations can be dropped, giving a set 
of t - 2 equations in t - 2 unknowns, to which Theorem 9.4 can be 
applied again. Eventually, if there are any errors at all, a set of 
equations that can be solved for the elementary symmetric functions 
of the error-location numbers results. 

The correction procedure consists of three phases: 


1. Calculate the parity checks and the even-numbered S.. 
2. From these, calculate the elementary symmetric functions v3. 
3. Finally, substitute each field element into the equation 

t-1 t-2 


t 
xX +0,X OLS Sit Adit aide 


Those field elements that satisfy this equation correspond to error 
locations. 


The second step involves a certain amount of trial and error be- 
cause it is possible to solve the equations and obtain correct solu- 
tions only when the number of equations used equals or exceeds by 
1 the number of errors that actually occur. This step might be 
carried out, as an alternative to the procedure described in the 
preceding paragraph, by starting with the assumption that two 
errors occurred, solving, and checking the solution. If the solution 
does not check, four errors would be assumed, and so forth. When 
a set of answers that checks occurs, it must be the correct solution. 

If it is assumed that the length n of the code approaches infinity 
and that the number of errors corrected, t, is a fixed fraction of 
n, the number of operations required for error correction can be 
crudely estimated as follows. The first phase, calculating parity 
checks, requires a number of operations proportional to the num- 
ber of symbols multiplied by the number of parity checks, or no 
more than nmt operations. This quantity nmt is proportional to 
n? log n. The second phase requires solving a t Xt set of equations 
The number of operations for this task is typically proportional to 
t?, but it may have to be done t/2 times. This will increase in the 
limit no faster than n*, Finally, substituting in a t-degree poly- 
nomial requires t multiplications and t additions of m digit 
numbers, and must be done n times, so that 2tmn ia a rough 
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estimate of the number of operations. This again would vary as n 


Mats) 


2 


log n. Thus the total number of operations certainly would increase 


as a small power of n. 


Example: Consider the (15,5) triple-error-correcting binary 
code discussed on page 166, The appropriate equations are 


Sy 4G eee) 

S +So +Sco +c =0 

3 Dad: bie 3 

S. +S. 0 +S. 6. +-Si¢., = 0 
5 wut 52 2°73 


The parity checks for the received vectors give S> 


S, = Si, and S, = St. Solving for the o's gives 


(9. 24) 


S, » and S, : 


(9. 25) 


Ss +s 
of 5 
o; = Ss oS = a ars 
s + S, 
2 3 6 
S, S, +S) i" Ss, tas 
* Se 
Ss +s 
1 3 
provided that Ss? +S +# 0. If there is only one error, S3 + S, = 0. 
Furthermore, if S? +S, = 0, then Newton's identities yield 
oe et and the equation 


3 2 
xX to, xX Pi te, 


W 


3 2 
Xx to, xX +o, Xt+o, 0, 


(Xto, (X?+o,) = (K+0,)(X+4Ne,)° = 0 


has two equal roots, which must be 0, and therefore there is 


only one error. 

As a numerical example, suppose that the 
is transmitted, and that errors occur in the 
seventh locations. Then 


r= (0100101000000 0 0) 
et me O81) 11 100 0) 

S = (1011) S x(1111) §= 
Referring to Table 6.1, one finds 


s = 8 = (1011)? =(a!9)* = ai 


8, = St wal wate (1101) 


vector of all O's 
second, fifth, and 


(1 0 0 0) 


qd} 


=(0111) 
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Then 
S, +S? = (1010) 40 
7 =8 = (1011)= a 
Sasias 
ORE Pe Sige AEST) 
2 $48 (1 0 1 0) 
3 1 
2 9 
« oe fee wee 
ae aid 
Similarly 
co = qd 


3 
It is then easy to verify that the equation 


X3 + al3 x? +4 Xa! = 9 


is satisfied by the three values X = a, ans and a°, and only these. 
These are the error-location numbers for the errors in r. 


9.6. Error Detection with the Bose-Chaudhuri Codes 


It is indicated in Chapter 1 that minimum distance t+ d+1 is 
required in order for a code simultaneously to correct all combi- 
nations of t or fewer errors and to detect all combinations of d= t 
or fewer errors. For a Bose-Chaudhuri code this amounts to speci- 
fying t +d elements as roots of every code polynomial {£(X)}, and 
results in t +d sets of parity checks S; available at the receiver 
for detection or correction of errors. A set of 2t values of S; are 
required by the correction procedures described in the neaeus 
two sections. If the solutions (Yj, Xj) for the error locations satisfy 
Equations 9.5 and 9.9 and if Equation 9.7 actually has a number of 
roots in GF(q™) equal to its degree, then the corresponding error 
pattern certainly could have caused the actual received vector, and 
hence must be the coset leader. Thus an error pattern with more 
than t 1's that is detectable but not correctable (in other words, 
there is no other vector of smaller weight in the same coset) must 
manifest itself in one of two ways: Either at least one of the d - t 
unused equations of the set of Equations 9.5 will fail to hold, or 
Equation 9.14 will not have v roots in GF(q™), and tests for these 
conditions can be used for error detection. 


9.7. The Use of Bose- Chaudhuri Codes with an Erasure Channel 


Any code with minimum distance d is capable of correcting any 
combination of d- 1 or fewer erasures. The correction may be 
done with Bose-Chaudhuri codes by solution of a set of linear 
equations, 

Assume that the received vector has erasures in positions 
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numbered x, 5 oS FAS AS ae Denote the unknown correct symbols 
bye Vern Loo -nc oe Y,. If the unknowns are replaced by 0's for the 
purpose of calculating the parity checks, they are the same as 
errors, and Equations 9.5, a set of d- 1 equations for a distance-d 
code, result. If v = d- 1, the first equations can be taken as v 
linear equations in v unknowns. The determinant of the coefficients 
has the same form as Equation 9.2 and so is not 0. Therefore it 
can be solved for the unknowns Y;, which are the erased symbols. 
Note that this method applies to the nonbinary as well as binary 
codes, 

Correction of combined erasures and errors can be done by an 
interesting procedure for the binary case, but no generalization 
has yet been found. If e erasures and t errors occur, they can 
be corrected, provided the minimum distance is at least 2t+te+t 1. 
(See Problem 1.5.) The same code is capable of correcting t + [e/2] 
errors, where [e/2] denotes the largest integer smaller than e/2. 
Now either [e/2] or fewer of the erased symbols are l|'s, or else 
[e/2] or fewer are 0's. Suppose that there are [e/2] or fewer l's 
Then if the erased symbols are replaced by O's and an error- 
correction procedure is applied, the correct code vector will 
result, since there are then t + [e/2] or fewer erroneous symbols 
in all. On the other hand, if there are [e/2] or fewer 0's among 
the erased symbols, then replacing the erased symbols by I's and 
applying a correction procedure will result in the correct code 
vector. 

This suggests that the erased symbols should first be replaced by 
0's and then by 1's, and a correction procedure applied in each 
case. If no more than t errors and e erasures have occurred, 
in one case or the other a correct code vector will result that differs 
in t or fewer of the unerased positions from the received vector. 
Then this must be the correct vector. 


NOTES 


The codes described in this chapter were discovered by R. C. Bose and 
D. K, Ray- Chaudhuri, 1°’) The codes discovered earlier by Reed and 
Solomon and described in Section 9, 3 turn out in an interesting way to be a 
special case of the generalized Bose-Chaudhuri codes, and as Bose- Chaudhuri 
codes they are most easily implemented, ‘The first error-correction procedure 
found’ was that of Section 9.5, Most of the codes, coding, and correction 
techniques generalize in a trivial way, but this correction scheme depends 
strongly on the fact that the parity«check calculations give certain symmetric 
functions of the error-location numbers in the binary case, Thus the discovery 
by Zierler and Gorenstein of the decoding scheme described in Section 9,4 was 
quite surpriaing!?? Kquations 9.9 are a generalisation of Newton! «identities. 
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The work on the use of Bose-Chaudhuri codes with erasures (Section 9. 7) 
was done by Blum and Weiss.® Melas®’ has found a class of double-error- 
correcting codes similar to the Bose-Chaudhuri codes. 

Since Chapter 9 was written, Solomon and Mattson have found a way of gen- 
eralizing the treatment in Section 9,3 to all Bose-Chaudhuri codes and have 
obtained important new results for some binary Bose-Chaudhuri codes. 
Solomon and Mattson plan to publish these results soon, 

Hocquenghem!'s work came to my attention after the book was completed. 
The codes described are equivalent to those found independently by Bose and 
Ray- Chaudhuri and described in this chapter. 


PROBLEMS 


9.1. Show that any binary code generated by g(X) = g*(X) which has 1 asa 
root is a Bose-Chaudhuri code of minimum distance at least 6. Show that 
this applies to either of the two (17, 8) binary cyclic codes. 


9.2. Show that if a in the definition of Bose-Chaudhuri codes is replaced by 


any other element ef a' of the same order e, an equivalent code results. 


(Hint: First show that a and a! can each be expressed as a power of the other.) 


9.3. Show that the Reed-Solomon code with symbols from GF(q) generated by 


sit a (he aike @ ie io eo 


where a is a primitive root of GF(q), has minimum distance exactly d. 





Chapter 10 


CYCLIC CODES FOR BURST-ERROR CORRECTION 


Fire codes, and other codes described in this chapter, correct 
a single-burst error in a code vector and require few parity-check 
symbols. These codes can be implemented almost as easily as 
Hamming codes. The Reed-Solomon codes described in Sections 
9.3 and 10.7 can be used where it is necessary to correct more 


than one burst in a received vector. 


The Fire codes with symbols from GF(q) are best defined in 
terms of their generator polynomial 


g(X) = p(X)(X° - 1) (10. 1) 


where p(X) is anirreducible polynomial of degree m over GF(q) 
whose roots have order e, and c is not divisible by e. The length 
n of the code is the least common multiple of e and c, for then 
g(X) divides X"- 1 but divides no X™' - 1 for n! <n. The number 
of parity checks is c + m, and the number of information symbols 
is k=n-c-m. Shorter codes with the same number of parity- 
checks symbols can be formed by simply making some information 
symbols always 0 and omitting them from transmitted and received 
vectors. (See Section 8.9.) 

It is shown in the following section that these codes are capable 
of correcting any single burst of length b or less and of simultane- 
ously detecting any burst of length d= b orlessif c= bt+d-1 
and m= b. For detection alone, the code is capable of detecting 
any combination of two bursts of which the length of the shorter 
burst is no greater than m and the sum of the lengths is no more 
than c +1, as well as any single burst of length no greater than 
c +m, the number of parity checks, (See Section 8.6.) 


Example: The binary Fire code generated by 


g(X) = (X'+ X74 1)(x" + 1) 


has m=7, c= 16, and the order of roots of X'+ X?+1 is 127, 
a prime number, Therefore, new 16% 127 « 2032, There are 
74168 23 parity-check aymbole and 2032 « 23 8 2009 infor- 
mation aymbola, This code could be uaed, for example, to cor- 


1As 
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rect all bursts of length 7 or less and detect all bursts of length 
10 or less, or to correct all bursts of length 5 or less and de- 
tect all bursts of length 12 or less. As a code purely for error 
detection, it will detect every single burst of length 23 or less 
and every combination of two bursts of which the shorter has 
length no greater than 7 and the sum of the lengths is no more 
than 17. 


10.2. Error-Correcting Capabilities of Fire Codes 


In order to assure that the code is able simultaneously to cor- 
rect every burst of length b or less and to detect every burst of 
length greater than b but no greater than d, it is necessary and 
sufficient that every burst of length b or less have no other burst 
of length d or less in its same coset. For pure error correction, 
taking d=b suffices. This is equivalent to requiring that the sum 
of a burst of length b anda burst of length d is not a code vector. 
This, in turn, is what is required for detection of any two bursts. 
Thus the following theorem proves the assertions made in Section 
10.1 about capabilities of Fire codes: 


Theorem 10.1. A vector that is the sum of a burst of length 
b or less and a burst of length d or less cannot be a code 
vector in a Fire code if 


btd-lsc (10. 2) 


and m is at least as large as the smaller of b and d. 


Proof: A burst of length b starting at the ith component can be 
represented by X*B(X), where B(X) is a polynomial of degree 
b- 1. Similarly a burst of length d starting in the j* component 
can be represented by XJD(X), where D(X) is a polynomial of 
degree d-1. It will be assumed that neither B(X) nor D(X) is 
divisible by X. Then, to prove the theorem, it is necessary to 
show that _{xX’*B(X) - XJD(X)} cannot be a code vector; in other 
words, X*B(X) - XJD(X) cannot be divisible by g(X). It will be 
assumed that f(X) = X*B(X) - XJD(X) is divisible by X° - 1, and 
on that assumption it will be shown that f(X) cannot be divisible 
by p(X). Then it could not be divisible by g(X) in any case. 

As the theorem is stated, B(X) and D(X) play the same role, 
and there is no loss of generality in assuming that iS j. Let 
j-izscs+r, OS r<c (by Equation6.2). Then 





£(X) = x'(B(x) - x™D(x)) - x? Dixy(x°® = 1) (10. 3) 


Since, by Theorem 6.19, X°*%~- 1 is divisible by X°- 1, and 
since f(X) is assumed to be divisible by X° - 1, x (B(x) - X™D(X)) 
must be divisible by X©° = 1 unless itis 0, Let 
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B(X) - X” D(X) = (X° - 1)H(X) (10. 4) 


and assume that H(X) is not equalto 0. Then the highest-degree 
term on the right has degree c +h, where h is the degree of 
H(X). Since B(X) has degree b-1, whichis less than c, the 
highest-degree term on the left has degree r+d- 1, so that 


rtd-lz=cth (10. 5) 


Combining Equations 10.2 and 10.5 gives r= bth. Since b= 1 
and h= 0, r2b and r>h. In Equation 10.4 there is a term 
on the left of degree r, since D(X) is assumed to have a term of 
0 degree, and B(X) has degree b-1< yr. There is no term on 
the right of degree r, since c>r>h. This contradiction leads 
to the conclusion that H(X) = 0, r=0, B(X) = D(X), and 


£(X) = x*D(xy(x°® - 1) 


Now consider whether {f(X) is divisible by p(X). Since B(X) = D(X), 
the degree m of p(X) is greater than the degree of D(X), so that 
p(X) is relatively prime to D(X). Itis also relatively prime to X, 
so that f(X) is divisible by p(X) if and only if X°*- 1 is divis- 
ible by p(X). Since j-i<n, cs <n. If p(X) is to divide a 
cs must be a multiple of e, the order of the roots of p(X). Itis 
therefore a multiple of n, the least common multiple of c and e. 
Since cs <n, this is impossible, so that p(X) cannot divide xe 

Pe QED 


The proof given here does not make clear the idea behind the 
design of these codes. The parity checks associated with the fac- 
tor X°-1 are c interlaced evenly spaced parity checks. Since 
the symbols involved in each check are spaced c symbols apart, 
each of the c parity checks will be affected by no more than one 
error in any burst of length c orless. Thus these parity checks 
give a sort of picture of the burst. Since b+d-1=c, any burst 
of length b or less will leave at least d- 1 successive parity 
checks unaffected, and this is sufficient to tell which symbol is at 
the beginning of the burst. It is also sufficient to distinguish be- 
tween a burst that consists of two errors with b - 2 0's between 
them and a burst that consists of two errors with d- 2 0's between 
them, the extreme case. 

Thus the factor X° - 1 is sufficient to detect a singie burst of 
length c or less and to determine completely the error pattern 
for bursts of length no greater than b, The additional information 
required to determine the location of the burat is provided by the 
factor p(X). This can be seen in the proof; the sum of two bursts 
XiB(X) and x) D(X) ie divimible by X® «1 only if the burst patterns 
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B(X) and D(X) are the same. If it is divisible by ae ae ee 
not divisible by p(X), and thus two bursts of the same pattern but 
different location are distinguished by the p(X) factor. 


10.3. Other Burst-Error~Correcting Codes 


The Fire codes are the largest class of burst-error-correcting 
codes known. They cover the entire range of burst lengths b and 
d and code length n. Certain other codes have been found, some 
of them requiring fewer parity checks than corresponding Fire codes, 
and these codes are listed in this section. All can be implemented 
by the methods of Sections 10.5 and 10.6. 

Hamming codes can be considered to be burst-error-correcting 
codes for bursts of length 1. It is interesting to note that the Fire 
code for bursts of length 1 requires c=1, g(X) = (1 + X)p(X), 
and the resulting code is the second type of nonbinary Hamming 
code presented in Section 8. 8. 

A binary code that corrects all bursts of length 2 or less is 
merely a code that corrects single and double adjacent errors. For 
this case the Hamming single-error-correcting double-error-detect- 
ing cyclic code can be used with the modification that when a double 
error is detected it is assumed to be a double adjacent error. This 
is the Abramson code.! 

Abramson’ has also attempted to find minimum- redundancy bi- 
nary cyclic codes for burst correction. For a cyclic code, every 
cyclic shift of a coset leader can be taken as a coset leader, by 
Theorem 11.2, and if this is done the bound given by Theorem 4.9 
should be modified as follows. The total number of burst patterns 
of length b or lessis (q - 1)q>-?, and each may start in any of 
the n symbols in the code. Thus the total number of cosets, in- 
cluding the code as one of them, is 


q™ = 14 n(q- 1)9q""" (10. 6) 


Abramson has shown that if n is to be the largest integer satisfy- 
ing Equation 10.6 for a binary code for bursts of length 3, then the’ 
generator polynomial must have the following form:? 


g(X) = (1 + X + X*)p(X) (10. 7) 


where p(X) is primitive and of even degree greater than 2; 
Abramson has devised a simplified test for determining whether a 
particular choice of p(X) is suitable or not, and has found, for 
example, the codes listed in Table 10.1. It appears very likely 
that there exist primitive polynomials p(X) of all even degrees 
greater than 2 for which Equation 10.7 gives the generator of a 
code for correcting all bursts of length 3 or leas, 
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Table 10.1. Generator Polynomials for Minimum Redundancy 


Triple-Adjacent-Error-Correcting Codes 


(X26 FAL(KS + KS) 
(x? +x 4+ 1)(x® +x +1) 
(Xx? 4X +1)(x® +X +x? +X+41) 
(XO eed) (KO i Klee OD) 
(x? +X + 1)(x® 4+ x8 +x? + XK +1) 


Melas®° has shown that in some cases the product of two prim- 
itive polynomials generates a cyclic code capable of correcting 
burst errors. Reiger” and Fire™ considered shortened cyclic 
codes generated by primitive polynomials, and Reiger has tabula- 
ted a few such codes for correcting burst errors. For both of these 
types of codes, the only way known for choosing the generator poly-~ 
nomials is trial and error. 

The following theorem gives one final special case. 


Theorem 10.2. Let V be the code resulting from shortening a 
binary Fire code in which c is an even integer to length n 
equal to the least common multiple of c/2 and e, thatis, to 
half of its natural length. In this code the sum of two bursts 
of length b or less cannot be a code vectorif 2b- 25 c and 
b= m. 


Proof: The proof involves only a slight modification of the proof 
of Theorem 10.1. In fact, if c= 2b-1, Theorem 10.1 applies, 
so that a proof is needed only for b=d and c=2b-2>0. Equa- 
tions 10.4 and 10.5 hold as before, but now b=d and c = 2b- 2, 
so that Equation 10.5 becomes 





ris, b.«.1.4 hb (10. 8) 


Since c = 2b- 2 > 0, Equation 10.8 implies that r >h. But also 
r < c, and therefore there is no term on the right side of Equation 
10.4 which has degree r. In order for the terms of degree r on 
the left side to cancel, r must be no greater than the degree of 
B(X); thatis, rS b- 1. This fact together with Equation 10. 8 
implies that h= 0, and if H(X) # 0, then H(X)=1. The case 
H(X) = 0 is handled as it was for Theorem 10.1. If H(X) = 1, then 
r=b-1 and 


be 


1 be 
B(X) « X°" D(X) = X°- 1a xX?7"?. 


1 


Since B(X) and D(X) have degree b-« 1, it follows that 


B(X) = D(X) « XP" 
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Then 


b-1 1 


HX) 2 + WG 5 ye He AXP 4 

and since r=b-1 and j-i=cs+r, j-i must be a multiple 

of b-1, Since p(X) is relatively prime to X and has degree greater 
than the degree of s*t 1, it divides f(X) only if it divides 

1+ XJ-1. If p(X) is to divide 1+ XJ"1, then j - i must be a mul- 
tiple of e, the order of the roots of p(X), as well as a multiple of 
b- 1; and therefore j - i must be a multiple of the code length n. 
This is impossible, and therefore if f(X) is divisible by X?°"* - 1, 
it cannot be divisible by p(X). QED 


10.4, Binary Codes for Correcting Bursts of Even Parity Only or 
Odd Parity Only 


The optimum code in the general case of a channel with dependent 
symbols would be a code that would correct as many as possible of 
the most likely error patterns. Without some idea of what sort of 
patterns are most likely in useful dependent channels, a general 
attack on finding good codes for dependent channels seems hopeless, 
Bur st-error-correcting codes have been studied on the premise that 
in certain channels the most likely error patterns are bursts. 

There is one other case of interest. In certain types of modula- 
tion systems for transmitting or recording binary digits, only bursts 
with an even number of errors are likely.®° If itis desired to pro- 
tect against burst of length b or less, only about half the patterns 
have an even number of 1's, and hence only half as many cosets 
are required, This indicates that one parity-check symbol might 
be eliminated. It turns out to be possible to replace one check 
symbol by an information symbol in a Fire code designed to correct 
bursts of length b or less and detect bursts of length b+1 to d, 
if c is odd, provided that only bursts of even parity or only bursts 
of odd parity are to be considered. 


Theorem 10.3. Let g(X) = p(x)(x° - 1)/(X - 1) be the gen- 
erator for a binary cyclic code, where p(X) is irreducible of 
degree m=2b and c is odd. Then a vector that consists of 
the sum of a burst of length b or less anda burst of length d 
or less, both of the same parity, cannot be a code vector in this 
code if b+d-l<=c. 


Proof: Let X"B(X) denote a burst of length b and x! D(X) a 
burst of length d, and consider their sum X*B(X) + XJD(X). Since 
B(X) and D(X) gave the same parity, B(1) = D(1), and if 





s(x) = x'B(x) - x) D(x) 
then 


f(1) = B(1) - Dil) = 0 
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Thus X - 1 is a factor of f(X). Since c is assumed odd, ¥° 21 
is not divisible by (X - 1)?, and therefore g(X) is not divisible by 
X-1. Therefore f(X) is divisible by g(X) if and only if it is 
divisible by p(X)(X° - 1). But Theorem 10.1 shows that f(X) is 
not divisible by p(X)(X© - 1). QED 


10.5. Implementing Burst-Error-Correcting Codes 

Suppose that a code vector {f(X)} is transmitted, and a burst 
of errors {XJB(X)} occurs. Then {£(X) + xXJB(X)} is received. 
The parity checks can be calculated at the receiver by dividing 
f(X) + XJB(X) by g(X), the generator of the code, and keeping the 
remainder, which would be 0 if a code vector is received and which 
otherwise contains information about the errors. Since {f(X)} 

a code vector, f(X) is divisible by g(X), and therefore the remain- 
der is the same as the remainder after dividing X/JB(X) by g(X). 
Let 

x B(X) = g(X)S(X) + R(X) (10. 9) 
where R(X) has degree less than n-k, the degree of g(X). The 
error-correction problem is to determine xJB(X), the exact form 
of the error, given R(X), the calculated parity checks. 

Assume that the code under consideration satisfies the following 
conditions. There is a certain set of error patterns B(X) that 
are "correctable" regardless of their position in the received vector: 
If B(X) is a correctable error pattern, then the vector resulting 
from j cyclical shifts, {X/B(X)}, is a coset leader for all j; and 
of course, if B(X) and D(X) are two different correctable error 
patterns, {xiB(xX)} and {X!D(X)} cannot be in the same coset for 
any i and j. Certain cosets may not contain a correctable error 
pattern; the occurrence of one of these corresponds to the detection 
of an uncorrectable error. Finally, assume that every correctable 
error pattern is a burst of length n-k or less. 

The full-length cyclic codes described so far in this chapter fit 
this description, and the following error-correcting procedure will 
work for any such code. (The modification required for shortened 
cyclic codes is described at the end of this section. ) 


1. Multiply R(X) by X and reduce modulo g(X); that is, divide 
by g(X) and keep the remainder, 

2. Check whether or not the resulting polynomial is a correct- 
able error pattern, If so, proceed to Step 3, If not, repeat Steps 
land 2 until either the above condition is satisfied or until Steps 1 
and 2 have been done n times, 

3. If after i steps the remainder R, (X) we put to be a correct- 
able error pattern, then the coset leader TT) R, (X)}, and sub- 
tracting this vector from the received vector ia the error 
if a correctable error pattern occurred, 
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4. If the resulting polynomial never turns out to be a correctable 
error pattern, then an uncorrectable error pattern has been de- 
tected. 


The proof that this procedure is valid follows: Suppose that the 
error that occurs is E(X). Let R(X) be the result of the parity- 
check calculation; that is, 


E(X) = g(X)S(X) + R(X) (10. 10) 


Let the remainder after multiplication by X" and division by g(X) 
be R, (X). Then 


xX’ R(X) = e(X)S (Xx) + R (x) (10. 11) 
and combining Equations 10.10 and 10.11 gives 
X°E(X) - R(X) = X"g(X)S(X) + e(X)S. (X) (10. 12) 


and therefore {X"E(X) - R (X)} is a code vector, and (xix(x)} 
and {R, (X)} must be in the same coset. Note that X?*E(X) may 
have degree greater than n, contrary to the usual assumption made 
here, If {X*E(X)} is an error pattern that can be detected but not 
corrected, no other pattern {R_ (X)} inthe same coset can be cor- 
rected either, and so no correctable error pattern occurs as a re- 
mainder in Step 2. ' 

Now assume that {E(X)} = {XJB(X)}, where B(X) is a correct- 
able error pattern, and let i=n- j. Then from Equation 10. 10, 


x*R(x) = x Bx) - xig¢xscx) 


(X™ - 1)B(X) - Xig(x)S(X) + B(X) 


and since g(X) divides xX". 1 and B(X) has degree less than 
n- k, the degree of g(X), B(X) must be the remainder after divi- 
sionof X*R(X) by g(X). Thus after n- j steps, a correctable 
error pattern, namely, B(X), will occur as the remainder. 

Finally, again assume that {E(X)} = {XJB(X)}, where B(X) is 
a correctable error pattern, and assume that after multiplication 
by X* a correctable error pattern R,(X) results. Then by Equa- 
tion 10.12, {xX*+JB(x)} and {R, (X)} are both in the same coset, 
and since they are both correctable error patterns, they must be 
equal, If the above procedure is followed, the error pattern would 
be taken to be R,(X), and the position n-« i, or the error vector, 
would be 
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xR oxy} = x7 AY (R, (x)} 


cx™ 4h ox pexy} = (x™ Bx} 


{x"} (xJB(x)} = (x3 B(x} 


which is the desired result. QED 


The argument in the previous paragraph may seem unnecessarily 
indirect. It was done this way to allow additional flexibility in the 
procedure. For example, consider a binary code of length n= 100, 
generated by g(X) of degree n- k= 20, and suppose that a single 
error occurs in the symbol corresponding to xs Then 


x°°R(X) = g(X)S,(X) + 1 


but also 


X31R(X) = g(X)S, (X) + X 


or 


X**R(X) = g(X)S,(X) + Xx’? 

and 1, X, and X! are all correctable error patterns, In each 
case the correction is properly made. The error pattern is taken 
to be 0d 30. 100M 31 POR as REO K te: respectively, and these are 
all equal. 

The encoding for these codes can be best accomplished by the 
method of Section 8.5. The shift register requires n-k stages 
and is shown in Figure 8.2. 

A particularly simple mechanization of the error correction is 


Logical Cirevit — Test for Error Pottern 











laput | Buller Temporary Storage 





Output 


Figure 10,1, An errorecorrection circuit for a 
burateerrorecorrecting code, 
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shown in simplified block-diagram form in Figure 10.1. It operates 
as follows: 


1, Parity checks are calculated by shifting the entire received 
vector {r(X)} into a device identical to that used for encoding. At 
the same time, the received vector is stored in a buffer storage. 

2. The contents of the shift register are tested for a correctable 
error pattern. (A pattern must be recognized when it is at the ex- 
treme right of the shift register. It is immaterial whether it is 
recognized earlier.) If no correctable error pattern is recognized, 
the register is shifted with no input, and simultaneously one symbol 
is read out of the buffer and this step is repeated. 

3. When a correctable pattern is recognized, it is the error pat- 
tern that presumably occurred, and the erroneous symbols in the 
received vector are the next ones to come out of the buffer. Gate l 
is closed, Gate 2 opened. Symbols are read out one at a time from 
the buffer and from the shift register, and the symbol coming out 
of the shift register is subtracted from the symbol coming out of 
the buffer. This corrects the error. The rest of the received mes- 
sage is read out of the buffer. 

4. If there are any parity-check failures and if no correctable 
error pattern occurs in the shift register by the time the entire re- 
ceived vector is read out of the buffer, an uncorrectable error has 
been detected. This can be implemented by using two flip-flop 
storage devices. The first, F,, is setto 1 ifever a 1 comes 
out of the high-order stage of the shift register after Step 1. Then 
F, stores a 1 if there are any parity-check failures. The second, 
F,, is set toa 1 by the output of the comparison devices, and is 
used, incidentally, to operate Gates 1 and 2. Then the following 
combinations are possible: 


FY = EF, = 0 No error 
Fy = Hive F =0 Uncorrectable error 
FI =F, = 1 Error corrected 


If the received vector is {r(X)}, the content of the shift register 
after the calculation of the parity checks is the remainder after di- 
viding xn-ky¢x) by g(X). After i more shifts, the entent of 
the shift register is the remainder after dividing wea +H (xX) by 
g(X). The automatic multiplication by X”™”* results in having the 
error pattern detected in the shift register before the erroneous 
symbols come out of the buffer. Thus, comparison with the pre- 
viously discussed procedure shows that, if a correctable pattern 
R, (X) is vechaaeese in the shift register after automatic multipli- 
cation by X™"* and after i additional shifts, the actual error 
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pattern is xine (X). Ifthe shift-register content is considered 

as an n- k- 1 degree polynomial, the content of the highest-order 
storage element is the coefficient of X®-*-! in (x) sor of Kote! 
in the error pattern Doig (X). Since the coefficient of Xiu in 
r(X) comes out of the buffer on the first shift, the coefficient of 
xP"! comes out on the (i + 1y8* shift. Thus the next symbol to 
come out of the buffer corresponds to the highest-order symbol in 
the shift register. The symbol coming out of the shift register should 
be subtracted from the symbol coming out of the buffer, to correct 
the error in that symbol, and similarly for the n- k- 1 succeed- 
ing symbols. 

It can be verified that a burst error at the beginning or end of the 
received vector causes no difficulty. The code, however, being 
cyclic, will have the capability of correcting an error pattern that 
begins near the end of the block and ends at the beginning, while the 
mechanization described here cannot actually correct such an error. 
That is, (000001 1) is a burst of length 2, and shifting it cycli- 
cally one unit to the right gives (1000001), whichis mathemati- 
cally also a burst of length 2 and potentially correctable. This way 
of mechanizing the code will not correct such an error. 


Example: The polynomial 
g(X) = (X° + X? + 1)(xX?+ 1) = (x!4 + x" + x94 X38 +X? 4:1) 


generates a binary Fire code of length n = 9(2° - 1) = 279, which 
corrects any single burst of length 5 orless. It has 14 check 
symbols and 279 - 14 = 265 information symbols. Encoding for 
this code can be done with the shift register shown in Figure 10.2, 
which is of the type described in Section 8.5. 


Input 











Output 
Figure 10.2. An encoder for a Fire code 
Its operation is described there. The error-correction circuit 


is shown in Figure 10, 3. ae 


——_ 


poy ot 


a - Test for all O's 








Figure 10,3, An errorecorrection eireult for a ire code 


194 error-correcting codes 


Note that the shift register is identical to that used for encoding. 
The operation of the corrector follows these steps: 


1. The entire received vector is read into the buffer and si- 
multaneously into the shift register, which is shifted each time 
a symbol enters. (Gate 1 is open; that is, it allows the input to 
pass to output. Gate 2 is closed.) 

2. The received vector is then read out of the buffer one sym- 
bol at a time, and the shift register is shifted once for each sym- 
bol, with no input. 

3. As soon as all 0's appear in the first 9 stages, the error 
pattern must be in the last 5, and the erroneous symbols are 
about to come out of the buffer. Gate 1 is closed, Gate 2 opened, 
and the symbols will be corrected. If the first 9 stages never 
contain all 0's, an uncorrectable error has been detected. 


It may be desirable to shorten a burst-error-correcting code 
either because bursts occur too frequently, or because the total 
length or number of information symbols is constrained by other 
system requirements. If a code of suitable natural length cannot 
be found, a code can be shortened simply by making some of the 
high-order information symbols identically 0 and omitting them. 
Then the encoding and parity-check calculation are not affected, 
since leading 0's do not affect them. It does, however, affect 
the error-correction procedure described above. Suppose, for 
example, that a code whose natural lengthis 735 is used but 300 
of the information symbols are omitted. Then the correction pro- 
cedure unaltered would require 300 shifts corresponding to the 
300 omitted information symbols, assumed to be 0's, before read- 
ing the actual received vector out of the buffer. One possible sim- 
plification could be achieved by an automatic premultiplication by 
x? modulo g(X) with the circuit shown in Figure 7.8. The tech- 
nique is illustrated in an example: 


Example: Suppose that a binary code is required that will cor- 
rect any burst of length 5 and has 200 information symbols. 
The code described in the previous example could be used if the 
high-order 65 information symbols init are made 0 and omit- 
ted. The same encoder can be used. The parity-check calcula- 
tion, as it stands, is the residue of X'*r(X) modulo g(X). An 
additional automatic multiplication by x*5 is desired; that is, 
the residue of X’’r(X) is desired. By tedious calculation, the 
remainder after dividing X’? by g(X) is found to be 


1+X+X? 4 X*4+ X74 X94 x04 XM + XY 


The error-correcting circuit is shown in Figure 10.4. It is used 
in exactly the same manner as the circuit shown in Figure 10, 3, 
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except that here code words consist of 200 information symbols and 
14 parity-check symbols instead of 265 information and 14 check 
symbols, as in the previous case. Input 














Test for all O's 





Inpu 


Buffer Storage 


Figure 10.4. Error-correction circuit for a shortened Fire code Output 


10.6. Another Error-Correction Procedure 


The procedure described in this section does not differ greatly 
from the one described in the previous section, but it will in some 
cases lead to a simpler circuit. It can be adapted to any code for 
which g(X) can be factored into two factors, each of degree at 
least as great as the length of any correctable burst. For sim- 
plicity, it will be described here specifically for the Fire codes. 

Suppose that a code vector {f(X)} is transmitted, and a burst 
oferrors {XJB(X)} occurs. Then {f(X) + XJB(X)} is received. 
In this case, parity checking is done by dividing f(X) + XJB(X) sep- 
arately by p(X) and x°- 1. The remainders will both be 0 for 
a code vector, and if they are not 0, they contain information about 
the errors. In this case, since {f(X)} is a code vector and there- 
fore f(X) is divisible by both p(X) and X° - 1, the remainders 
are the same as the remainders after dividing XJB(X) by p(X) and 
x°-1. Let 


xB(X) = p(X)S, (X) + R(X) 
: (10. 13) 


c 


x/B(X) = (KS - 1)S, (X) +R, (X) 


where R(X) has degree less than m, the degree of p(X), and 
R,(X) had degree less than c. 
The following procedure can be used for error correction: 


1. Multiply R(X) by X and reduce modulo p(X); thatis, di- 
vide by p(X) and keep the remainder. Multiply R, (X) by X and 
reduce modulo X° ~ 1. 

2. Compare the resulting polynomials, If they are equal and have 
degree less than b, proceed to Step 3, If not, repeat Steps 1 and 2 
until either the above condition is satiafied or until Steps 1 and 2 
have been done n times, 
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3. If the resulting polynomials ever turn out to be equal and of 
degree less than b, these polynomials are both equal to B(X), and 
Step 1 was executed n-j times. Thus the error pattern B(X) and 
the location j have been found, and the error can be corrected by 
subtracting {XJB(X)} from the received vector. 

4. If the resulting polynomials never turn out to be equal and of 
degree less than b, then an uncorrectable error has been detected. 


The proof is closely analogous to that given for the error-correc- 
tion procedure given in the preceding section, and will therefore be 
omitted. 

Calculation of parity checks can be accomplished using two shift 
registers of the type described in Section 8.5, one for p(X) and 
one for X°- 1, modified so that they automatically multiply the 
input by x™. In these devices, shifting with no input is equivalent 
to multiplying by X and reducing modulo p(X) and X - 1, respectively. 
The circuit is shown in Figure 10.5, specifically for the Fire code dis- 
cussed in the example on page 193. It operates in the following way: 








Test for 0 











Input 


Figure 10.5, An error-correction circuit for a Fire code 


1. The received vector is brought in simultaneously to the buffer 
and the two parity-check registers, with each of the registers being 
shifted as each received symbol enters. (Gate 2 is open, Gate 1 
closed. ) 

2. The received vector is read out of the buffer, and for each 
symbol read out, the two registers are simultaneously shifted, This 
is continued until the first b stages in the two registers match 
exactly, and all other stages are 0, or until the entire received 
vector is read out of the buffer. 

3. If the registers ever match, the error pattern is in both reg- 
isters, and the error is in the next b symbols that are to come 
out of the buffer. Now Gate 1 should be opened, Gate 2 closed. As 
the symbols continue to come out of the buffer, the shift registers 
are also shifted once per symbol, and the error pattern is subtracted 
from the received vector. Because of Gate 2, the X° - | shift 
register will contain 0's and not affect the rest of the received 
vector, Thus the output is correct, 

4. If the entire received vector is read out of the buffer but the 
matching condition is never met, an uncorreetable error has been 
detected, The suggeationa for implementing error detection made 
in the previous section apply here alae, 
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The automatic multiplication of the inputs by x" in the shift 
registers is necessary to make the test conditions satisfied before, 
rather than after, the erroneous part of the received vector comes 
out of the buffer. It is also necessary because without it an error 
in the end of the received vector would cause the test conditions to 
be satisfied at the beginning rather than at the end of the processing. 

If a code shorter than a Fire code of its natural length is required, 
some high-order information symbols can be made 0 and omitted. 
Encoding will not be affected. The error-correction procedure is 
affected again in the same way as in the previous section and can 
be handled in essentially the same way. There is one simplification, 
however. A total of any multiple of e shifts leaves the p(X) reg- 
ister unaffected. Furthermore, any multiple of c shifts leaves 
the X° - 1 register unaffected, and any number of shifts in the 
X°- 1 register can be handled simply by shifting the input connec- 
tion to the register. 


Example: Error correction for the shortened Fire code discus- 
sed in the example on page 194 can be implemented also with the 
circuit shown in Figure 10.6. The explanation of this circuit 
follows. 





Input 





Figure 10.6. An error-correction circuit for a shortened Fire code 


The code is obtained by shortening the Fire code generated by 
g(X) = x4 4 xl 4 x94 x5 + X2 4.1, whose normal length n is 
279, by omitting 65 information symbols. The second type of 
error-correction circuit for the full-length code is shown in 
Figure 10.5. It must be modified by introducing the equivalent 
of 65 extra shifts in both shift registers or, in other words, by 
multiplying the input to each shift register by x’ ; Since the 
input is already multiplied by X~ = x® in the dbo shown in 
Figure 10.5, now the input must be multiplied by X7°. In the 
xX’ . 1 register, any multiple of 9 shifts has no effect, so that 
70 shifts have the same effect as 70-6367 shifts. The equiv- 
alent of 7 shifts can be effected by connecting the input to the 
eighth stage of the register, Inthe X'+ X'4 1 register, any 
multiple of 31 shifte has no effect, and therefore multiplication 
by X'° is equivalent to multiplication by XT" « X*, The residue 
of X* modulo X' + X*4t te Xa X* 41, andinthe X* 4 Xo 4 
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register, multiplication by X® is equivalent to multiplication by 
X3+ X? +1. This can be achieved by connecting the input to the 


first, third, and fourth stages in that register, as shown in Fig- 
ure 10.6. 

In other respects this circuit is the same and operates in the 
same way as that shown in Figure 10.5. 

The circuit shown in Figure 10.4 and that shown in Figure 10.6 
give exactly the same end result for every input vector. In this 
particular case the one in Figure 10.6 requires less equipment. 
Similarly, the circuits in Figures 10.3 and 10.5 are equivalent, 
with the type shown in Figure 10. 3 requiring less equipment. 


10.7. Another Approach to Burst-Error Correction 
ee ee ee OTT ECHON 


A code with symbols in GF(q’*) that corrects all burst of t or 
fewer errors can be used for burst-error correction on a channel 
that uses symbols from GF(q). The elements of GF(q') are sim- 
ply coded into blocks of r symbols from GF(q). Then a burst of 
length (t - 1)r +1 or less can affect at most t successive blocks 
and thus can be corrected. 

One possible arrangement is to use a Fire code based on symbols 
from GF(q™). Aclear comparison is not easily made. It is quite 
possible that this arrangement would offer advantages under some 
circumstances, but generally equipment is simpler with the straight- 
forward application of Fire codes. 

Another possibility would be the Bose-Chaudhuri codes. The 
most favorable case is the case m= 1, that is, the Reed-Solomon 
codes. (See Section 9.3.) These codes are quite efficient for burst 
correction and have the ability to correct more than one burst per 
block, 

Consider the case of a Reed-Solomon t-error-correcting code 
over GF(q"). Then 2t or fewer elements of GF(q‘) would be 
required for parity checks — this is equivalent to 2tr symbols of 
GF(q). The code length would be (quto1) symbols, and it could 
correct any single burst of length (t- 1)r +1 orless. A Fire code 
to correct bursts of length (t - 1)r + 1 could be constructed using 
a primitive polynomial of degree (t- 1)r+1 and c= 2(t-1)r+1. 
The total number of parity checks would be S(t =2)r's52. For 
t= 3, the Bose~Chaudhuri codes require fewer parity checks. The 
length n of the Fire code will in general be much greater, 





Example: A Reed-Solomon code with symbols from GF(2’) and 
t = 4 could be used by coding symbols as blocks of 7 binary 
digits to correct all bursts of length 22 or less. It would re- 
quire 2x 4=8 blocks or 8x 7 = 56 binary symbols as parity 
checks. The code length would be 7 x (27- 1) = 889, 

A Fire code to correct all bursts of length 22 or less would 
require m= 22, c=2 x 22-1, oratotal of mt+c = 65 binary 
digits as parity checks, The code length could be as great as 
(242 . 1) x 43,. or approximately 160 million binary digits, 
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On the other hand, a burst of length 8 binary digits or less could 
affect at most two elements of GF(2"’), and thus the Reed-Solomon 
code could correct any two bursts of length 8 orless. It could 
correct as many as four bursts if each happened to lie within a 
single GF(2") element. 


The Reed-Solomon codes can, of course, be implemented by the 
methods described in Section 9.4. Alternatively, if correction of 
single bursts only is sufficient, the methods of Sections 10.5 or 10.6 
can be used, The latter would require less equipment, and the ad- 
ditional error-correcting ability of the code is turned to idiindd eke ~ 
tion: Any error pattern that the code could correct, if fully utilized, 
it could certainly still detect. 


NOTES 


The first cyclic burst-error-correcting code — was Abramson's oils 
error, double-adjacent-error-correcting code, *” and this was the star — 
point for all the other work on cyclic codes that correct single bursts. a8 
important class of codes found by Fire?’ resulted directly from an ray aS ie ay 
generalize Abramson's work, Further work has been done by Melas, eiger, 

8) . . 
eee ca papers mentioned in the previous paragraph discuss een 
tion. The methods given in this chapter are bie although they rier ie: oe 
tially refinements of Abramson! s!}4 and Meggitt's’? methods. Meggi m 
is described in Section 11.1. 
Section 10.7 is based on a paper by Reed and Solomon. 
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PROBLEMS 


10.1. Show that for every n and b there is a cyclic code of length n ca- 
pable of correcting any single burst of erasures of length b or less that 
requires b check symbols. (Compare with Problem 4. Le) 


10.2. The following and other similar types of binary codes have been pro- 
posed for error correction, The symbols are arranged in a rectangular array 


as follows: 


x Xx X x x 
u 22 33 44 55 
Xx xX xX x x 
16 a 32 43 54 
Xx x x Xx x 
6 26 un 42 53 
x X xX Xx X 
4 a aT “ Ba 
x x x x X 
if) “a ” 46 ot 
x x x x x 


i a” “ an a6 
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Parity checks are satisfied as follows: 


. Xs = 0, that is, parity checks on columns 
‘i 


0, that is, parity checks on diagonals 


NS 
“8 
J 


The symbols are transmitted row by row, left to right, top to bottom. 
This can be extended to an m-column, (m + 1)-row array with 2m +1 
parity-check equations. 
a. Show that there are only 2m independent parity-check equations. 
b. Show by an elementary geometric argument that this code can correct 
any single burst of length b or less if m= 2b - 1. 
c. Show that this is the cyclic code generated by (XE - 1x) 1)/(X = 1) 
and devise a circuit for an encoder. j 
d. Give an algebraic proof, similar to that given for the Fire codes, that 
these codes will correct any single burst of length b or less if m= 2b - 1, 
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OTHER DECODING METHODS 


In this chapter are described three related methods of decoding 
that use to advantage the symmetry properties of cyclic codes, 
The first is an interesting generalization of the decoding method 
presented in the preceding chapter to other than burst-error- 
correcting codes. The first and second are essentially the step- 
by-step decoding of Section 3.4. The second and third methods 
apply to other than cyclic codes but are especially appropriate 
for cyclic codes. 

All three of these decoding methods appear to be simpler than 
that described for Bose-Chaudhuri codes in Chapter 9 for short 
codes. For long codes, however, all three require tedious, if 
not impossible, analysis of the individual code to be used and also, 
to the best of our knowledge now, an excessive amount of equip- 
ment. Nevertheless, it is quite possible that further development 
of the theory will alleviate both of these difficulties. 


11.1. A General Decoder for Cyclic Codes 


The type of decoding, or error correction, described in this 
section applies in principle to any cyclic code. A typical circuit 
is shown in Figure 11.1 for the binary Fire code considered in 


Input 






Combinational Logic Circuit 


Output 


Figure 11,1. Another decoder for a Fire code 


Section 10,5, The operation follows the following outline, which 
for simplicity is given for the binary case: 


1, The received vector ia read into the buffer and simultane- 
ously into the shift register that caleulates the syndrome, using 
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a shift register of the type shown in Figure 8. 2. 

2. There is a one-to-one correspondence between the syndrome, 
which appears in the shift register, and the coset leader, which is 
the error pattern assumed to have occurred. The combinational 
logical circuit is designed to have a 1 at its output if and only if 
the syndrome in the shift register corresponds to an error pattern 
with an error in the highest-order symbol, which is the symbol 
about to come out of the buffer. 

Thus ifa 1 appears at the output of the logical circuit, the next 
symbol to come out of the buffer must be corrected. This is ac- 
complished by reading a symbol out of the buffer and adding to it 
the output of the logical circuit. 

3. At the same time that the symbol is read out of the buffer, 
the shift register is shifted. If the first symbol coming out of the 
buffer is corrected, the syndrome must also be altered by adding 
the output of the logical circuit to the feedback of the shift register. 
This makes the syndrome correspond to the altered received vec- 
tor, a fact discussed in more detail below. 

4. Steps 2 and 3 are repeated until the entire received vector is 
read out of the buffer. Reading a symbol out of the buffer means 
essentially shifting it one symbol to the right. For each symbol 
read out of the buffer, both the buffer and the parity-check shift 
register have been shifted one symbol to the right. Since the code 
is cyclic, this leaves everything essentially as it was initially, 
and the output of the logical circuit indicates each time whether 
or not the next symbol coming out of the buffer should be corrected. 

5. After the received vector is read out, the errors will have 
been corrected if they correspond to a pattern built into the logical 
circuit, and the shift register will contain all 0's. If the shift 
register does not contain all 0's at the end of the process, an error 
uncorrectable with the given logical circuit has been detected. 


One aspect of the procedure requires further justification, and 
that is the claim that the syndrome is correctly modified at each 
stage to correspond to the received vector in the buffer. Let 
{b(X)} denote the contents of the buffer and {r(X)} the received 
vector, At the beginning of the correction procedure the received 
vector is in the buffer, that is, b(X) = r(X), and the syndrome is 
the residue of xk, (x) modulo g(X), the generator polynomial of 
the code. Therefore, initially the syndrome shift register contains 
the residue of xn- kp( x) modulo g(X). The following three para- 
graphs show that this relationship between buffer contents and syn- 
drome is maintained throughout the correction procedure. 

The syndrome and buffer contents are affected by two operations: 
(1) a symbol is read out of the buffer, and simultaneously the syn- 
drome shift register is shifted; (2) whenever the output of the 
logical circuit is 1, the symbol that has just come out of the buffer 
is corrected, anda 1 is added into the feedback line of the 
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syndrome shift register. The next two paragraphs show that each 
of these operations maintains the desired relationship between the 
syndrome and the buffer contents. 

As was already noted, shifting one symbol out of the buffer can 
be thought of as multiplying the contents of the buffer by X, and 
shifting the parity-check shift register is equivalent to multiplying 
by X and reducing modulo g(X), the generator of the code. Thus 
the syndrome and the received vector certainly match after a shift 
if no correction is made. 

A correction adds X™ into the shifted received verter, since the 
highest-order position in the buffer corresponds to x?-* and the 
correction is added to the symbol that has come out. Therefore, 
the addition of X2 X2-* reduced modulo g(X) to the parity-check 
shift register will compensate for the addition of X” to the re- 
ceived vector. But X™- 1 is divisible by g(X), and therefore 
xn xn-k gives the same remainder as 1xn-k after division by 
g(X), and for this reason, adding 1xn-k jin the parity-check regis- 
ter will compensate for adding X™ into the received vector. But 
adding a 1 in the feedback circuit of the shift register adds the 
equivalent of xm-K into the shift register, and therefore the cor- 
rection shown in Figure 11.1 does result in a consistent syndrome 
and received vector at all times. 

The generalization to cyclic codes with symbols in an arbitrary 
field is straightforward. The logical circuit must have as its out- 
put the field element that corresponds to the amount of error in 
the symbol coming out of the buffer. This must be subtracted from 
the symbol coming out of the buffer and from the signal on the feed- 
back line of the shift register. 

With the possible exception of the logical circuit, the entire de- 
coder is simple. Whether or not this method is practical depends 
entirely on the complexity of that logical circuit. For burst-error- 
correcting codes, the logical circuit is in general very practical. 
Comparison with the decoding method described in Section 10.5 
shows exactly what the logical circuit must be: The output should 
be a 1 (for the binary case) if a correctable error pattern appears 
in the parity-check shift register anda 1 in the highest-order 
position. In particular, the Fire code corresponding to the feed~- 
back connections in Figure 11.1 is a code that corrects all bursts 
of length 5 or less. The logical circuit should have a 1 as output 
whenever the 9 low-order stages of the parity-check shift regis- 
ter are 0 and simultaneously a 1 appears in the highest-order 
position. This is certainly very practical, and in fact is merely 
a variation of the circuit shown in Figure 10, 3. 

For codes such as the Bose» Chaudhuri codes that correct ran- 
dom patterns of errors, the situation is quite different. There is 
a priori no reason to expect the logical cireuit to be simple, One 
possible approach is to Heat the input combinations for which the 
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output of the logical circuit should be 1, and on a computer find the 
minimum two-level logical circuit by standard minimization tech- 
niques. This was tried for the Bose-Chaudhuri (15,7) and (31,21) 
double-error-~correcting codes and the Bose-Chaudhuri (USPS); 
(31,16), and the Golay (23, 12) triple-error- correcting codes, The 
circuits did not simplify a great deal. For example, for the (23,12) 
code, the minimum two-level logical circuit had about one-third 
fewer terms than the original expression. Further factoring re- 
duced the ratio to one-half or a little less. There are 1 single 
error, 22 double errors, and 22 x 21 = 462 triple errors with l's 
in their last component, with the result that a total of 485 terms 
appear in the original expression. Half of this number still re- 
quires a costly logical circuit. 

For double-error-correcting codes, this decoding method may 
be practical in many cases. The logical expression is not too 
complex at the outset. There are 1 single-error pattern and n- 1 
double-error patterns with a 1 in the last position, and therefore 
a double-error corrector for an (n,k) code would require at most 
an nX (n - k) switching matrix as its combinational switching cir- 
cuit. For the Bose-Chaudhuri (31,21) code, this would meana 
31 X 10 matrix, which is not entirely unreasonable. 

An alternative approach would be to try to exploit the structure 
of the code in some way. For example, one might ask under what 
conditions changing the next symbol to come out of the buffer re- 
sults ina received vector in a coset of lower weight. If, for 
example, the weight of the coset could be calculated in a practical 
way from the syndrome or received vector, it could be readily 
determined whether changing the next symbol would reduce the 
weight of the coset leader, and thus it could be determined whether 
the next symbol should be changed. This question is considered 
in the next section. It relates to the step-by-step decoding dis- 
cussed in Section 3.4, of which the decoding described in this sec- 
tion is essentially a special case. 


11.2. The Use of Code Symmetry in Step-by-Step Decoding 


This section describes a way of calculating the weight of the co- 
set leader of the coset containing a given received vector. Such 
a calculation can be used to implement step-by-step decoding. 
(See Section 3.4.) The method will, for simplicity, be given only 
for binary codes, though it can be extended to the more general 
case. The calculation consists of forming a linear combination as 
real numbers of the results of a number of parity checks. The 
method makes use of the symmetry of the code, that is, the group 
of permutations of vector components which leave the code invari- 
ant. The theory is based on the algebraic theory of group repre- 
sentations and of group characters, which is a highly developed 
area of mathematics, It is outside the scope of this book to give ; 
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a general introduction to this theory. However, elementary proofs 
are given for the fundamental theorems as they apply to binary 
codes. 

Let V, denote an (n,k) binary group code, and V, denote the 
null space of V,. Let P denote a permutation on n symbols, 
and let v, P denote the vector that results from applying the per- 
mutation P to the n components of v,- Moreover, P may be 
considered to be a permutation matrix, which has one 1 in each 
row and each column, and has 0's in all other positions. Finally, 
let G be a group of permutations P having the property that if 
v is a vector in V, then, for every P in G, vP is also a vector 
in V,. The group G is said to leave the code We invariant, 


Example: If P is the permutation on n symbols which permutes 
the components of a vector cyclically one position to the right, 
the permutations 1, P, Pp’, ...P2-! form a group that leaves 
any cyclic (n,k) code invariant. Quite commonly, codes will 
have larger symmetry groups—the Golay (23,12) can be shown 

to be left invariant by the Mathieu group.” 


Theorem 11.1. If V, is invariant under a group G of per- 
mutations P, then the null space V, of V, is also invariant 
under G. 


Proof: Note that for any two vectors v, and ¥, and any per- 
mutation P, 

Yiot Ayoee hoa (Vo 2) (A 4) 
for each side is the sum of products of corresponding components 
of v, and v, —the right side differing from the left only in having 
the terms rearranged according to the permutation P, This cer- 
tainly does not affect the sum, and therefore the two sides are 
equal, 

Let v, be a vector in V, and v, any vector in V, - Then 
-1 -1 

er a Boy, Ps (y, PP) se vy (vrs) 
but p"} isin G since G isa group. Consequently, v, P aga 
vector in V, ; and since v, is in the null space of V, , 

-1 

(v, P)> vy, = v2 * (vy, P ) = 0 
Thus v, P is orthogonal to any v, inV,, and it follows that Ve as 
isinV,. QED 
Theorem 11,2, If U is a coset of V, which is left invariant 
by P, then the set UP of all vectors formed by applying P 
to a vector in U is also a coset of V, . 


Proof; Let u, and u, be any two vectors in U, Then UPisa 
coset if and only if u, P= u, P ia a code vector, thatia, a vector 
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in ve Et 


»P = (u,-u,)P (11, 2) 


uy Ps i 
and since U is acoset,u, - u,, andtherefore (uy, - u,)P, are 
code vectors, The truth of Equation 11.2 can be seen by noting 
that it does not matter whether one permutes first and then sub- 
tracts, or vice versa. Alternatively, if the permutations are 
written as matrices, Equation 11.2 follows from the distributive 
law for matrix multiplication. QED 


A group G of permutations on n symbols divides the space V 
of all n-component vectors into classes, with two vectors Vv and 
v, inthe same class whenever there is a permutation P in G 


ie which v, P = v,. Ifacode V, is left invariant by G, then 
V, must consist of a number of complete classes of V. Theorem 
11.1 states that the null space also consists of a number of com- 
plete classes. 

For a given code vie , two cosets U;, and U, are said to be 
equivalent if there is a P in G such that U, P=U,. The cosets 
then divide into classes also, with U, and U, in the same class 
if and only if they are equivalent. If U; and U, are equivalent, 
a permutation of a minimum weight element of U, appears inU,, 
and vice versa, and therefore Uz and U, have the same minimum 
weight. 


Example: Consider the set of all 7-component vectors over 
GF(2) and the group 1, P, P’, ..., P® of cyclic permutations. 
The 128 vectors fall into 20 classes. One vector of each class 
is listed in Table 11.1. The others are cyclic shifts of these. 
The vectors of all 1's and all 0's each form a class of one 
element. The others have 7 vectors in each class, which are 
the 7 cyclic shifts of the given vector. The cyclic (7,4) code 


Table 11.1. Classes of 7-Component Vectors 


AS :0'0).010''0.O80) Els Y-180100 10)" K OF000 ah Te te 1 1 ae 
Be-l0' 0 '0:.0:0 0% Gel 2540/1 0.005 » sy OO One Ti (OF 00)" 1 a) diem 
Cod 10:0 0,00) (Lot 070.1 0.0 «:Mi0 O-lelsOel ids GR80:0 1 diel 
De tO. 1 3020000 TP L100. 0-270, “NOvO Ter ool SO) 1 Oot lamas 
1.00, 10007, J.) O° 70) 10°09 “©3010 tO nt TO 1) 0 1 


given in the example in Section 8.2 is made up of classes A, I, N, 
and P, a total 16 vectors. The null space consists of the 0 vec- 
tor and the class N only, a total of 8 vectors, There are only 
two classes of cosets, one being the code itself and the other 
consisting of the seven cosets whose leaders are in class B, It 
is true in general that the number of classes in the null space 
equals the number of classes of cosets—this fact will come out 


of the theory later, 
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Next consider a set of real-valued functions of n-tuples. There 


is one function defined for each n-tuple v: 
vev 


x(y) = 1 fa 1- ave y) (11. 3) 


where v-v, is the scalar product in GF(2), the result being either 
lor 0. The remainder of the calculation is done by considering the 
l or 0 to be a real number. These functions are called group charac- 


ters. Note that xX (%) Nive x, (v). 
1 


Theorem 11, 3. 


xy + v2.) = XCM XL (v ) 


and 
Xel% KM) = Xgge Ma) 
Proof: By Equation 11. 3, 
ve (v, + vy a 2 sab 
x (vy, tv, ) = (-1) = (-1) 


The addition of yv- %, and v-+ v, is over GF(2). However, 
vevitvev vev vv, 


oe 2h. 


as can be easily checked by considering the four possible cases 


(Vesey, (= 05 we. v. = 0), (v- v, =1, v- v, = 0), (v- vy, = 0, 
v:v, =1), and(v- vy, = 1, v+ v, =0). Thus, 
vev vev 


xylyy typ) = (I) (1)? = xylvy) xyly,) 


which proves the first part of the theorem. The proof of the second 
part is analogous. QED 


Theorem 11.4. Let V, be any k-dimensional subspace of the 
space of all n-tuples and let V, be its null space: 


0 if v'is notin wir 


Ses a (11. 4) 


allvin Vv; all vin VE, 2k if v'isin :o 


Proof: If viisin V,, v- v'=0 for every v inV, , and hence 
every term inthe sum is 1. Since there are 2K vectors in Na 
the sum is 2", If v' is notin V_, then there exists at least one 
v in V, for whichv: v' al, e set of all vectors v in V, for 
which v. v'= 0 can easily be shown to form a subspace V,. The 
set of all v for which v+ v' «1 form a coset of this space, since 
ifv,+> vim landv,. wml, (v, = v,)+ vie O and hence v, - v, 
is in the subspace Vy: Therefore, v» ¥v' © O for exactly half the 
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vectors v, and v- v'=1 for the other half. Thus half the terms 
in the sum (10.4) are +1 and half are -1, and the sumis 0. QED 


Theorem 11.5. Let V_ be the space of all n-tuples: 


n 
2 6(v, + v,) 


Y xylya) xylv) 


allvinV 
and 
n 
xy, Oxy, W) = 276 ty, + yD 
allvinV 
where 
Ae i if ytv, = 0 


DAE Ve ¥. ye O 


iT] 


These are orthogonality relations. 


Proof: Since x,(¥,) ae (v), both sums are equal. By Theorem 
bl 3 i 

Ky xy) = x) + ¥,) 
and then the theorem follows from Theorem 11.4 and the fact that 
the only vector in the null space of V is the 0 vector. QED 


Theorem 11.6. Any real-valued function f(v) on the space of 
n-tuples can be expressed in the form 


ri Gig ats ] a, Kaiv (11. 5) 
allv'inV 
where 
ae he y f(v) x, (v) (11. 6) 
allvinV 


Proof: Consider the set of all real-valued functions f(v) on the 
space of n-tuples v in V. nit is easily verified that they forma 
vector space. The set of 2 functions 


h. (v) = 6(v! + v) 


for all v' in V forms a basis, for they are linearly independent, 
and any function f(v) can be expressed as a linear combination of 
them: 





other decoding methods 209 


y= Dyn 
all v! 
Therefore, the dimension of this space of functions is 2". But 
there are also 2" characters x_,(v) that are orthogonal by Theorem 
11.5, and hence are linearly independent. Consequently, they also 
are a basis and any function can be expressed as a linear combination 
of them as in Equation 11.5. 

Equation 11.6 can be verified by substituting Equation 11.5 for 
f(v) in the right-hand side of Equation 11.6 and simplifying, using 
Theorem 11.5. (Note that this is analogous to a Fourier series 
expansion. ) QED 


The function f(v) in Theorem 11.6 certainly can be taken to be the 
weight of the coset leader of the coset containing v, and thus the 
weight function can be written in the form of Equation 11.5. It re- 
mains only to investigate how much the expansion can be simplified 
by knowledge of the symmetry of the code. 


Theorem 11.7. Let Ne be an (n, k) linear code invariant under 
permutations P ina group G. Let 


iy}, a ) a, x, (¥) (11.7) 
allv' inV 
be a function constant on classes of cosets of V Then (1), 


a_, = 0 unless v' isin the null space of Ne , and (2), a Fe 


for any v' andany P inthe group G. 


Proof: By Theorem 11.6, 


v' 
all v in V 


Let U,, 1 Six2™-* denote the cosets of V, in V. Let v; denote 
the coset leader of U;. Also let f(U;) denote the value that f(v) has 
for every v in Uj. Then, by Theorem 11.6, 


"9 Cae ae a a 


all U; allvin U; 


a) «(U)) > 


all U, allvin v, 


f(v) oe (v) 


X ys ( v +) 
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and Theorem 11.3 gives 


-n F 
a =2 \ {(U,) X (v9) y Xv (v) 
all U. allvin Ma 


Now by Theorem 11. 4, 


yxy te) =0 


allvin ME 


if v' is not in the null space of V_, and the sum is 2* iiavn Me an 
the null space of V,_. Thus a7 0 if v' is not inthe null space 
of Wine However, if v' is inthe null space of V, , 


janewere y £(U)X ya (¥4) 


v'! 
allU, 
i 
By Equations 11.1 and 11.3, 
-(n-k) -(n-k > re 
Age? (U;)X, ply) = 27") > 0) x, (4P7) 


all U; all U; 


But £(Uj) = £(U;P +), since f is assumed constant on classes of co- 
sets. Also, the set of all cosets U,;P- includes all cosets U;, and 
y,P7l can be taken as the coset leader of u,;P-!. Therefore, 


oe 5 - -1 (ak) 
ay e 2 “a £(U;P i X(vyP } ae £(U)X. (v,) 
all U. allU, 
i i 
=a QED 
v! ; 
Equation 11.7 can be written in a different form. Let W, denote 
the jth class of vectors in if , the null space of Ts, , Defint 


v= ay (11.8) 
af Si 


and then define aj as the value that a. has for all v' in W;- 


' 
Theorem 11.8. The functions b5(v) are orthogonal; 


' ' = n 
2 Wey (v) = 64,2 (11.9) 
allvinV 
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where 5jk = 0 if j# k, 6jj = 1, and hj is the number of vectors 
in W;. Furthermore, any function f(v) that is constant on 
classes of cosets of * can be expressed in the form 


Uvjie > au jv) (11. 10) 
j 

2° * sv) (v) (11.11) 
J allvinv 


Proof: 


Foye DF 


allvinV lt ua all v'tin Wi allvinV 


Xun (v) Xyu(v) 


If j # k, each of the last sums is 0 by Theorem 11.5. If j=k, 
again by Theorem 11.5, only the h; sums for which v' = v'' are 
nonzero, and each of them has the value 2", which proves Equation 
11.9. Again, Equation 11.11 is proved by substituting for f(v) from 
Equation 11.10 into Equation 11.11 and simplifying the right side 
with the aid of the orthogonality relation Equation 11.9, in exactly 
the manner used with Fourier series. QED 


It follows from Theorem 11.8 that the number of classes of cosets 
is equal to the number of classes of vectors in the null space, for 
the dimension of the space of functions constant on classes of cosets 
is equal to both. 

Example: Consider the (7, 4) binary code discussed earlier in 

this section. There are just two classes of vectors in the null 

space, the classes A and N. 


¥am= >, 


allv'inA 


xt) = (19% 21 


lv) = >» Xv) = 7- 2[(0011101)- v+(1001110)-. v 


allv' inN 
POUL OO elon vide Cl OO OpOl2 a1) sab (2. 1.0.2.0.0.1)-v 


#(1110100)* ¥4#(011101 0). vI 


The dot product ia carried out ag a GI(2) operation, but all other 
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operations are ordinary arithmetic. It is easily verified that 
W.(v) = 7 for any code vector, -1 for any other vector, and 
thus if f(v) is the function equal to the weight of the coset leader 
of the coset containing v, 


fv) = % Ya) - 3 HW) 


This is really just one-fourth of the number of failures among 
the 7 parity checks calculated. Of course, for this code it is 
necessary to calculate only the syndrome 


Poul Oid 
Va) Oneal OF® 
OUOE eT 


S =. 
mS & 


and note that if the syndrome is 0, the weight of the coset leader 
is 0, while if the syndrome is not 0, the weight of the coset 
leader is 1, since this is a Hamming code. 


It is not easy to obtain nontrivial examples, since so far the 
only way known to find the functions /, is to enumerate the classes 
in the null space of the code; for codes of even modest lengths, this 
is a tedious task. Itis, of course, not necessary to use the exact 
expansion of the weight function, but only enough functions ; to 
distinguish the different weights — this can lead to some simplifi- 
cation. Other examples can be found in References 115, 127, and 
128, 

At first sight, it would appear to be highly desirable to have a 
large symmetry group G so that there would be as few as possible 
classes in the null space of the code, and thus as few as possible 
functions required to distinguish weights of coset leaders. If there 
are few classes, however, some of them must have many vectors, 
and for them the calculation of the corresponding  5(v) is lengthy. 
In fact, if every U.(v) must be calculated, the calculation is very 
likely too lengthy to be practical. This method must depend on 
not needing all the functions .(v). Theorem 11.8 states that any 


function that is constant on classes of cosets is a linear combination. 


of the w jy) Both Wells and Zierler have observed that in the few 
specific cases they studied all of the ):(v) can be expressed as an 
algebraic but nonlinear function of a few selected ;(v). In such 
cases, these few suffice. Further investigation along these lines 
might give needed insight into these problems. 

It is also not at all obvious that the functions Ww .(v) are the most 
convenient invariants. The rank of the matrix in Equation 9.12 
is probably a much more efficient indicator of the number of errors 
in a Bose- Chaudhuri code than these group characters for long 
codes, Another possibility is discussed in the next section: A 
calculation very little more complicated than that required for a 
single function vi (v) yields several independent invariants, 
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11.3. Reed Decoding Algorithms 


Let L be an nxr matrix of 1's and 0's whose r columns are 
elements of the null space ade of an (n,k) binary code V+ Any 
vector of the null space is essentially a parity-check rule satisfied 
by code vectors. For any received vector v, vL isa vector of r 
1's and 0's which contains 1's in the positions corresponding to 
parity-check rules that v fails to satisfy. Now consider the re- 
sult of multiplying (vL) by LT! as real numbers. The result will be 
a vector of n components that are integers: 


ei a etslae (11. 12) 


There will be a contribution of 1 in the jth component of e for 
each column of L which both fails as a parity check and contains 
av inate jth position. Thus the jth component of e is the num- 
ber of failures of parity checks that involve the jth symbol in the 
code vectors. 

Now one might expect, at least under certain circumstances, that 
a symbol involved in a large number of parity checks that fail is 
probably inerror. This would be especially true if the columns of 
L were chosen to have a low density of 1's, for then the probability 
would be minimized that a particular column vector in L would 
correspond to a parity check involving more than one error. Thus, 
for certain codes and the proper choice of L, it is possible to de- 
vise an error-correction algorithm for which the decision concerning 
whether or not a symbol should be changed is based on the number of 
failures of parity checks involving that symbol. Because they are 
related to the decoding for Reed-Muller codes, in which decisions 
are also made on the basis of the number of a certain set of parity 
checks that are satisfied, these are called Reed decoding algorithms. 

Gallager has made an interesting study starting from this point. 
Using random-coding-type arguments related to those of Section4. 4, 
he has shown that there exist codes that are null spaces of matrices 
with a low density of 1's and that have error probabilities not much 
poorer than those given by random-coding arguments for codes in 
general. He has described a decoding method that is a refinement 
of the Reed decoding algorithms. Finally, he has demonstrated 
the feasibility of these methods by computer simulation of the error- 
correction procedures for codes with randomly chosen parity- check 
rules of length as great as 500. With this length and rate 1/2, typi- 
cally patterns of as many as 40 errors could be corrected, and with 
rate 1/4, patterns of about 80 errors could be corrected. The fact 
that such large error patterns could be corrected in a modest amount 
of time is really quite surprising, and indicates that such methods 
may prove to be practical, 

Prange has devised Reed decoding algorithms for several cyclic 
codes, ‘T'wo of these will be deseribed here without proof, The 
proofa can be found in References 94 and 94, and consiat essentially 
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of first characterizing the symmetry classes of cosets and showing 
that the algorithms treat all vectors in a class in an equivalent way, 
and then exhaustively showing that the algorithm does the proper 
correction for each class. 

The parameters for the two codes are 


Case I. 
TS eZ ee Ly He i, y= 4 
c = (1010000110010... 0) 
and 
Case II. 


n= 73, k=45, B24, y= 5 
c = (10100000001000000000000011000100000010000010010.. . 0) 


Each is the cyclic code generated by c. There are 8 classes of 
cosets for the first code, 56 for the second. Results of a study” 
of coset classes are summarized in Table 11.2—a similar table 
for the (73,45) code appears in Reference 93. In the table, n,(v) 
is the number of components of the vector e(v) which equal ‘ 


Table 11.2. Summary of Coset Types for (21,11) Code 


Coset Frequency of Values of e; Number of 
Type ny(v) n, (v) n, (v) n,(v) n,(v) n,(v) Cosets 

0 21 0 0 0 0 0 1 

1 0 20 0 0 0 1 el 

2 3 0 16 0 2 0 210 

oh 0 9 0 [2 0 0 280 

4! 0 0 12 0 9 0 280 

34 0 2 0 16 0 3 210 

42 1 0 0 0 20 0 21 

> 0 0 0 0 0 21 1 


For each of the two codes, the matrix L is a square matrix 


consisting of all cyclic shifts of the vector c. The decoding algo- 
rithm is as follows: q 


1. Calculate e(v) = (e 
2. Calculate @ = (é, 
= Lut ef nb. 

3. Ifthe weight of € is less than y, take v + @ as the corrected 
vector. Otherwise, say that an error has been detected, but do not 
correct. 


Atha eeu s 


,e 
i ~ “ i 
@,,-++,€n), where 6; = Oife;= p, and 


h 2 
Fi 


For the (21,11) code, this algorithm corrects all error patterns 
of two or fewer errors and in addition 210 triple errors that have 
minimum weight in their coset. All other cosets result in error 
detection, and in every case in which correction is done, the as- 
sumed error pattern has minimum weight in its coset, For the 
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(73, 45) code, the algorithm corrects all errors of weight 4 or less 
and results in error detection for all other cosets. 

Prange has given algorithms also for (23,12), (21,12), and (73, 45) 
codes, and has described algorithms capable of maximum-likelihood 
correction for all cosets for all these codes. In some cases the 
matrix L may contain all cyclic shifts of more than one vector. 
The decoding algorithm given by Prange for the Golay (23,12) code 
in cyclic form uses the cyclic shifts of 11 vectors, probably more 
than are necessary. 

There is an interesting connection between these algorithms and 
the ideas of the preceding section. In the notation of that section, 
let V_ be acode, V, its null space, and G a group of permutations 
that leave V, invariant. Now let the columns of the matrix L con- 
sist of one or more complete symmetry classes of V,. Then if P 
is a permutation matrix in G, applying P to the components of 
any columnof L simply gives another column of L, and thus ap- 
plying P to the rows of L is equivalent to applying some other 
permutation Q to the columns of L: 


PL = LQ 

The vector e for vP is 
e(vP) (vP)LL? = v(PL) uf = vier Scie = vL(LQ” ‘ 
vid? 1 = wine per y* rer at - 


TE 


TT 


HT] 


and this is just the same permutation P applied to the vector e(v) 
calculated for v. Also, since the columns of L are in the null 
space V,, any two vectors in the same coset result in the same 
vector e(v). Thus any two vectors in equivalent cosets have as- 
sociated with them vectors e(v) that are related by a permutation. 
Finally, if nj(v) denotes the number of components of e(v) that 
are equal to i, then for each i, n;(v) is the same for any two vec~ 
tors in equivalent cosets. They are, therefore, by Theorem 11.8, 
linear combinations of the functions ';(v) defined in Equation 11.8. 

The computation of e is not a great deal more complicated than 
the calculation of a single function /.(v), and it gives several inde- 
pendent functions nj;(v) that may be used to distinguish classes of 
cosets. In particular, for the (21,11) code, these n;(v) are suffi- 
cient to distinguish all the classes of cosets (see Table 11.1) and 
thus are sufficient for step-by-step maximum-likelihood decoding 
for the binary symmetric channel, For the (73,45) code, they are 
sufficient to determine whether the coset leader has weight 4 or 
less, and if so, what the weight is. This is sufficient for step-by- 
step decoding whenever no more than 4 errors occur, and for de- 
tection whenever the received vector i# in a coset of weight greater 
than 4, 

The fact still remains that, while these functions nj(v) are an 
adequate basia for decisions in atepeby«atep decoding for the 
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(21,11) and (73,45) codes at least, and they are generally simpler 
to calculate than the set of functions W 5(v) described in Section 11. 3, 
it appears that the Reed decoding algorithm is simpler and more 
economical than step-by-step decoding at least for these codes. 
Both methods show promise that can be appraised accurately only 
after further research. 


NOTES 


The clever decoding circuit described in Section 11.1 was found by Meggitt. 7 


In his paper he uses the type of parity-check calculations described in Section 


8.4, whereas the type described in Section 8.5 is used here. The latter choice 


will usually, but not always, be more economical. Meggitt also uses the type 
of circuit that corresponds to the companion matrix of Equation 7. 37, rather 
than that of Equation 7. 36 which is used throughout most of this book. 

Prange meee suggested the use of coset equivalence in analyzing linear 
codes and in justifying decoding algorithms. He applied these ideas to a num- 
ber of specific codes, and Section 11.3 is based on this work. Prange's work 
inspired Wells and later Zierler to study the problem of finding a complete 
set of functions for distinguishing classes of cosets. Section 11.2 is based 
on their work. Wells' report!!® gives a good review of the theory of group 
representations and group characters in fairly simple language. Zierler's 
reports!*7? 128 sive examples as well as theory, including a good decoding al- 
gorithm for the Golay (23,12) code. Gallager's work appears in Reference 45, 





Chapter 12 


RECURRENT CODES 


In contrast to all codes described in previous chapters, those 
described in this chapter are not block codes but instead a kind of 
continuous processing of information with check symbols inter- 
spersed among information symbols and with no natural beginning 
point or ending point. They are more difficult to analyze than 
block codes. A satisfactory, complete theory of this general type 
of code has not yet developed. However, several specific examples 
of these codes have been found to be sufficiently promising to en- 
courage further study. The burst-error-correcting codes of 
Hagelbarger that consist of alternate information and check sym- 
bols implement more simply than any other known codes. Techni- 
ques similar to those used for cyclic codes, and even some of the 
results of the analysis presented in the preceding four chapters, 
find application here. 


12.1. Definition of a Recurrent Code 


A recurrent (n, k) code is defined in terms of the encoding pro- 
cess: information symbols enter the encoder in blocks of k sym- 
bols, and encoded symbols leave in blocks of n symbols. Each 
of the n output symbols is the output of a linear finite-state trans- 
ducer, or linear coding filter. The general scheme is illustrated 


in Figure 12.1. The ai designate the k input symbols at time i, 


oH 
ae: 


cm 


aren Bl eee Figure 12.1, A general encoder for a recurrent 
4 (n, k) code 


bal} , 
ba bai 
aki— 


the b;; the n output symbols at time i. The symbols are as- 
sumed to be elements of a finite field. Each of the boxes in the 
diagram represents a linear finite-state transducer, that is, a 
circuit composed of adders, constant-multipliers, and storage 
devices, 
If none of the boxes contains memory, then the recurrent (n, k) 

code reduces to an ordinary (n, k) block code, Whereas an effi- 
cient block code must have a large n to average the effects of 


bij 


: 


aly 








— 
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noise over a long time, this same effect can be achieved ina re- 
current code with small n because of the memory in the coding 
transducers. 

The input to the encoder thus consists of k sequences of sym- 
bols, and the output consists of n sequences of symbols. In prac- 


tice, the input would most commonly be originally a single sequence, 


converted into k sequences. Similarly, the output would typically, 
though not necessarily, be transmitted serially. 

Finally, just as most block codes are used in a form in which the 
first k symbols ina block are unaltered information and the last 
n- kare check symbols, for all the recurrent codes so far studied 
in detail, the first k symbols in the output block are unaltered in- 
formation symbols (delayed, in some cases). This arrangement 
generally simplifies both the encoding and the decoding. 


12.2 Hagelbarger Burst-Error~ Correcting Codes 


The codes described in this section are simple in structure, and 
therefore easily understood. At the same time they are easily 
mechanized and efficient enough to be practical. The codes pre- 
sented here differ from those described in Hagelbarger's original 
paper, in which each check symbol is a parity check on information 
symbols that will follow it. Here the parity-check symbol is trans- 
mitted after the information symbols that it checks. This latter 
arrangement requires less equipment for mechanization and re- 
sults ina smaller over-all delay for (n, k) codes with k > l. 

First consider a simple (2, 1) recurrent code that illustrates the 
ideas. This code corrects any burst of length 6 preceded and fol- 
lowed by an error-free ''guard-space'' of length 19. The encoder 
is shown in Figure 12.2. There is one sequence of input symbols. 
There are two sequences of output symbols, one a duplicate of the 
input information, the other obtained from the shift-register-type 
transducer. Symbols are transmitted alternately from the two out- 
put sequences. Thus for aninput sequence 1101011001111 

.., the first output sequence is a duplicate of the input sequence, 


and the check-symbol output sequence is 0001100110010..., 


as can be easily verified. (It is assumed that the shift register 
initially is set at all 0's.) The transmitted sequence is formed 
by taking the first information symbol, then the first check 
symbol, then the second information symbol, and the second 
check symbol, and so forth. For the above information se- 
quence and check-symbol sequence, the transmitted sequence is 


Input 





Figure 12,2, Encoder for a simple recurrent (2, 1) code 
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1 Oy FOO OMS 101 AO ONO T2011 Oo OE 0; 

At the receiver, the received sequence is divided into two se- 
quences, and from the information symbols the parity-check sym-~- 
bols are recalculated. These are added modulo 2 to the received 
check symbols to form the pattern of parity-check failures, that 
is, the syndrome. In the absence of errors the syndrome is a 
sequence of all 0's. 

If errors occur, a pattern occurs in the syndrome that enables 
with this code the correction of any burst of length 6 or less. To 
see how this occurs, assume that a sequence of all 0's is trans- 
mitted, and that000000111011000000, a burst of length 
6, is received. This is split, if the first symbol is assumed 
to be an information symbol, into an information sequence 


000111000... anda check symbol sequence000101000.... 


The syndrome is, as can be verified from Figure 12.3, 





Figure 12.3. Syndrome calculation and error-correction 
circuit for a simple recurrent code 


000101111111000.... The syndrome consists of the 
error pattern in the check symbols, followed by two copies of the 
error pattern in the information symbols, and it is not difficult to 
see from the structure of the parity-check circuit that this is al- 
ways the case for bursts of total length 6 or less. Since the syn- 
drome shows the error pattern in both the parity-check symbols 
and in the information symbols, the error can be corrected. 

Circuitry is shown in Figure 12.3 for correcting the errors in 
information symbols. It is based on the fact that such an error 
shows up as a 1, repeated three time units later, and followed by 
a 0 three time units later. 

A guard space of 9 correct information symbols and their asso- 
ciated check symbols is sufficient to permit correction of succes- 
sive bursts. Thus if the guard space starts with an information 
symbol, the guard space must be 18 symbols; while if the guard 
space starts with a check symbol, 19 correct symbols may be 
required. This follows from the fact that it is sufficient (and 
sometimes necessary) to have three 0's following the last 1 in 
the syndrome, After 6 correct information symbols and their 
associated check symbols have entered the circuit that calculates 
the syndrome, it contains correct symbols only, and 3 more cor- 
rect pairs of symbole will result in 3 0'@ in the syndrome, 
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First Information Sequence 


Second Information Seq 





Third Information Sequence 


Figure 12.4. An encoder for a (4, 3) Hagelbarger code 
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Second Information Seq 
Third Information 


First Information Sequence 


Check Symbols 


Figure 12.5. An encoder for a (4, 3) Hagelbarger code 
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A recurrent (n, n - 1) code of the same type can be constructed. 
The method will be illustrated for a (4, 3) code that corrects bursts 
of length 4. The first step is to choose n binary vectors: 

slot eG 0n0. (00:0 (0070 

=NOtO ee Obl 0.0.0.4, 0n0%0 
2 (i221) 

= 00 #0:0°0 1-1-1 0 0x0 


S500 280° Or (050-0). 0) 02k 
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$ 


eee 
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This array consists of n rows and n columns of binary vectors. 
On the diagonal are the binary representations of the numbers 3, 
5, ..., 2n- 1, 1, and all other entries are 0. The leading 0's 
in the first column may be dropped. 

These vectors determine the connectidns on the shift register in 
which the parity-check symbols are calculated. The shift register 
has one fewer stages than the number of columns. The vector V 
determines the points at which the first information- symbol se- 
quence is connected, ¥, determines connections for the second 
information sequence, and so on, and the last row indicates the 
connection for parity-check symbols. The encoder for the (4, 3) 
code is shown in Figure 12.4. 

If a code for correcting bursts of length 8 is desired, it is ob- 
tained by forming a new set of vectors from V,, V,; Vy? and V, 
by inserting a column of 0's between each pair of columns in 
Equation 12.1: 


Pociy <070'0"0"'0"°0" 0 6*OF0"0%0 "50 O70 70) 070 
000 010001 000000 000000 
0.0°0, 000000 O11 O01 0 T (0'01010; 070 


me = 0.0.0, 0:0:0:0:0:0 0.0,0)0°0.0. (0.070 0:0)1 


Lf 

Vv 
2 

Vv 
3 


An encoder for this code is shown in Figure 12.5, anda different 
but equivalent encoder is shown in Figure 12.6. From Figure 12.5 
it can be seen that each check symbol is a parity check on a cer- 
tain set of 7 previously transmitted information symbols, one for 
each input connection to the shift register. It is easily seen that 
the circuit shown in Figure 12.6 makes the same calculation. 
Now consider the correction procedure. The syndrome could 
be calculated using the circuit shown in Figure 12.7. In the ab- 
sence of errors, the syndrome is all 0's, and it depends only on 
the error pattern. A burst of over-all length 8 affects at most 
two successive symbols in any one information sequence or in the 
sequence of check symbols, If a burst-error pattern abcdefgh 
starts with a symbol in the firet information sequence, then ae 
are in the first information sequence, b f in the second, ¢ g in 
the third, and dh are errora in the cheek symbols, With this 
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error pattern, the syndrome will first be affected by the check- 
symbol errors dh. Thenthere will be 4 0's; the third information 
sequence affects the syndrome 6 time units later than the check- 
symbol errors, because they are fed into the shift register 6 stages 
earlier. Because the third information sequence is connected to the 
shift register at three points, the pattern of errors in the 

third information sequence is repeated three times. Errors 

in the second information sequence affect the syndrome still 
later, and finally errors in the first information sequence affect 
it. The complete syndrome for this error pattern would be 
dhoo000cgcgecgbf00bfaeaeOO. Thus the error pat- 
terns in the individual sequences are isolated, and each is re-~ 
peated in a unique pattern enabling identification of the sequence 

to which it belongs. 

The results are essentially the same if the burst starts at 
a different point. For example, if a burst-error pattern 
abcdefgh starts with the third information sequence, errors 
ae occur in the third information sequence, bf in the check 
symbol sequence, c g in the first and dh in the second infor- 
mation sequences. It may be verified that the syndrome is 
bfO000aeaeaeO0dhO0O0dhcgeg0OO. Again the pattern 
of repetitions is characteristic of the channel in which the errors 
occurred, 

An error-correcting circuit that can be used with the syndrome 
calculation of Figure 12.7 is shownin Figure 12.8. The identi- 
fication of the channel in which the error occurs is made from the 
values of R, S, and T. For example, if all three are 1's, the 
corresponding error must have been in the third information chan- 
nel. The delay between the time when an erroneous symbol is re- 
ceived and when it is identified and corrected is different for the 
different channels, and hence the shift registers in Figure 12.8 
are needed for storing the information pending identification of the 
errors. The delay is 22 units for the first information channel, 

16 units for the second, and 10 units for the third. 

Some economy in equipment results if the syndrome is calculated 
using the circuit of Figure 12.6. The complete error-correcting 
circuit is shown in Figure 12.9. 

To refill the entire error corrector with correct symbols, 96 
successive correct symbols are sufficient, and therefore a guard 
space of 95 correct symbols between bursts is sufficient to permit 
correction of successive bursts. 

This code is systematic enough so that formulas can be given for 
equipment requirements and guard space. Consider an (n, n-1) 
code that corrects bursts of length b, which is a multiple of n. 
Let L(n) denote the smallest integer equal to or greater than 
1+ log, n, The encoder shown in Figure 12,4 or Figure 12.5 
requires 
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Figure 12.6. An alternative encoder for a Hagelbarger (4, 3) code 








Figure 12.7, Syndrome calculation for a Hagelbarger (4, 3) code 
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(b/n)(L(n)(n - 1) + 1) 


stages. For the decoder shown in Figure 12.9, the syndrome regis- 
ter requires 


(b/n)(L(n) - 1) 








































+ 3 stages. The total number of stages in the first information- 
LJ sequence line must equal the total delay from the entrance of 
a a = fo an erroneous symbol in the first information sequence until that 
te 3 8 symbol can first affect the last stage of the syndrome register. 
2 3 Sil eh: The erroneous symbol causes a 1 to enter the syndrome regis- 
a) | ia i * ter after (b/n)(L(n)(n - 1) + 1) - (b/n) stages, and the length of the 
: = syndrome register must be added to this. Thus the first, as well 
* r yi g 
eu he € is as each of the other information lines, requires 
= 3 is oO r tol) 
: a8) fe 2 Ro H (b/n)(nL(n) = 1) 
5] [a 3 Be} 
4| | a = d 1) stages. The total number of shift-register or delay stages required 
me «=|: R 2 is therefore 
3 
* & 3 = 3 (n - 1)(b/n)(nL(n) - 1) + (b/n)(L(n) - 1) 
H 
uy i & = (b/n)((n? - n+ 1) L(n) - n) 
“ H 
+e) LD ig og 2 With respect to the error-free guard space required between 
5 Bria ba Fe a Ps ® bursts, the worst combination is an error in the first information 
A P42 P sequence at the end of one burst and an error in the check symbols 
¢ z 9 at the beginning of the next. The reason is that the first infor- 
ie Gide mation sequence is the one that is delayed longest before affectin 
fe § S q y g g 
e iad ha H the syndrome, while the check symbols are not delayed at all. The 
Me o delay between the time when an error enters the first information 
9 pues) 2g sequence and the time when the corresponding 1 leaves the syn- 
FA 3 3 $ rt | g drome register is the sum of the delay in the circuit that calculates 
3 $ $ F; p 2 the syndrome and the delay in the syndrome register: 
i a] [2] |} ® ‘a (b/n)(L(n)(n - 1) + 1) + (b/n)(L(n) - 1) = bL(n) 
4 4 The circuit will contain only correct symbols after this number of 
oo iH 3 o blocks of n correct symbols occurs. Thus the guard space re- 
s ° ° wma a 
: $ es 3 3 a quired is 
a fl g y ‘| ° nbL(n) - 1 
< 2 § i | es] ; 
3] E| 3 oo oo symbols. On the other hand, if an error occurs in the first infor- 
5 =| 2 fy hy mation sequence, followed by nbL(n) - 2 correct symbols, and 
3| 8] 2 finally by an error, which will be a check symbol, this results in 
zl fl # yPy y 


a pattern in the syndrome register which is misinterpreted as an 
error in some other sequence of information symbols. 

The cireuits shown in Figures 12,2 and 12,3 for a simple (2, 1) 
recurrent code differ from those in Figures 12,5 and 12,9, The 
simple (2, 1) recurrent code can be modified for other burat lengths, 
and it can be shown that the number of shifteregiater or delay stages 


Fiew information Sequence 
Second information Sequence 
Third Information Sequence 
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required is b for the encoder, 5b/2 for the decoder, and a guard 
space of length 3b + 1 always suffices. Some values for guard- 
space and equipment requirements are listed in Table 12.1. 


Table 12.1. Equipment and Guard-Space Requirements 
for Hagelbarger Codes* 


Block Burst Encoder Decoder Guard 
Length Length Stages Stages Space 
n b (Figure 12.5) (Figure 12.9) 
2 2 3 4 e 
4 6 8 15 
6 9 LZ 25 
8 ie 16 Ht 
10 5 20 39 
iy 18 24 47 
3 3 7 18 26 
6 14 36 53 
9 yal 48 80 
12 28 2 107 
4 4 10 35 47 
8 20 70 95 
12 30 105 143 
5 5 se 79 99 
10 34 158 199 
n b (Figure 12.2) (Figure 12. 3) 
2 Zz 5 7 
4 4 10 AS 
6 6 15 19 
8 8 20 20 
10 10 25 ou 
iz 12 30 37 


* The values in this table differ from those given by Hagelbarger™® 
for two reasons. In the first place, the circuits given here are 
different in details, although the principles are the same. Sec- 
ond, the convention for circuit representation is different here 
from that used by Hagelbarger. In many of his diagrams, 
Hagelbarger shows one more stage than is shown here, That 
stage is assumed here to be at the source of the signal. Thus 

in some cases numbers given in Table 12.1 are one less than 
those given by Hagelbarger for a completely equivalent circuit, 
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12.3. Burst-Error Detection with Recurrent Codes 


Consider first, for simplicity, the (2, 1) recurrent code shown 
in Figure 12.10. The conditions a burst-error pattern must satisfy 
in order to result in no parity- check failures may be determined as 


Information Information 





£X)/9(X) 


Check Symbols 





F(X) /g(X) 


Figure 12.10 Block diagram of an error-detection system 


Check Symbols 





follows. The transducer that calculates the check symbols is charac- 
terized by the transfer function f(X)/g(X). If there are no errors 
in transmission, the output of the transducer exactly matches the 
received check symbols, and the difference, which is the syn- 
drome, is 0. Since the transducer is linear, the output of the 
error detector when a pattern of errors is added to the input is 
the sum (1) of the output with information and no errors, and (2) 
the output with the error pattern but all 0's in place of the infor- 
mation. Since the syndrome is 0 with no errors, the syndrome 
depends only on the error pattern and is independent of the infor- 
mation symbols. It can therefore be studied with all 0's as 
information. 

A burst-error pattern can be considered to be a polynomial, 
since it has a finite number of nonzero symbols. Assume that 
E;(X) is the pattern of errors among the information symbols and 
that E,(X) is the error pattern among check symbols, with the 
high-order coefficients taken as the symbols that come first in 
time, in accordance with the convention stated in Section 7.1. Then 
by Equation 7.19, the effect of the filter is to multiply its input by 
£*(X) and divide by g*(X). Thus for an undetected error 


“Fim ~ B,(X) = 0 (12. 3) 
and since g*(X) is not 0, this is equivalent to 
E,(X) #*(X) = E_(X) g*(X) (12. 4) 


(Note that a polynomial cannot be a null sequence of a transducer.) 
If h(X) denotes the greatest common divisor of f*(X) and g*(X) 
and 


B™(X) = gy (X) h(X) 
{*(X) = £ (X) h(x) 


then 




















228 error-correcting codes 


E,(X) £, (X) = E (X) g,(X) (12.5) 


and since f,(X) and g,(X) are relatively prime, g, (X) must be a 
factor of E;(X) and f£,(X) must be a factor of E (X)- Since this 
restriction on Ey (X) and E,(X) is independent Sf h(X), the com- 
mon factor of f*(X) and g*(X), inthe interest of equipment sim- 
plicity, h(X) would normally be taken to be 1. Thatis, f*(X) and 
g*(X) would be taken to be relatively prime. This will be assumed 
henceforth, and for this case E;(X) must be a multiple of g*(X) 
and E,(X) a multiple of £*(X). 

Now if £*(X) has degree f and g*(X) has degree g, then Ey(X) 
must have degree at least g and E,(X) must have degree f; that 
is, every undetectable error pattern involves both a burst of length 
greater than g among information symbols and a burst of length 
greater than f among check symbols. 

It is possible to guarantee detection of other likely patterns of 
errors by the proper choice of the polynomials £*(X) and g*(X). 
Since E;(X) is a multiple of g*(X), it is a code vector in the cy- 
clic code generated by g*(X). Results given in Chapters 8 through 
11 can be used to choose g*(X) in such a way that further restric- 
tions are placed on any E;(X) corresponding to an undetected error. 
In particular, Fire codes can be used to detect pairs of bursts, and 
Bose-Chaudhuri codes can be used to detect long bursts with low 
error density. 

Specifically, let g*(X), of degree r, generate an n-symbol cy- 
clic code of minimum distance d. Then no code vector has weight 
less than d; an equivalent statement is that no polynomial multiple 
of g*(X) of degree less than n has fewer than d nonzero terms. 
The recurrent (2, 1) code with this polynomial g*(X) as the de- 
nominator of the transducer transfer function then is guaranteed 
to detect any error pattern E;(X) among information symbols 
which is a burst of length r or less, or which is a burst of length 
n or less and contains fewer than d errors inall. Note that this 
is a condition only on the errors in information symbols. A simi- 
lar condition, depending on the choice of £*(X), must be satisfied 
by E,(X). Even if these conditions prove to hold, it is unlikely 
that E;(X) and E,(X) would satisfy Equation 12.4 and therefore 
be undetected. 

The case of a single isolated burst has been discussed. It seems 
quite clear that if two bursts are separated sufficiently, and each 
alone would have been detected, then both will. Now consider how 
large a guard space between bursts is sufficient to guarantee de- 
tection of both bursts. Suppose that 


E,(X) = Ey) (X) + Ep) (X) 





E.(X) = E,, (X) + EB. (X) 
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and suppose that E,)(X) and Ey)(X) both have degree less than e, 
while the terms of lowest degree in Ey2(X) and E,2(X) have degree 
e+g. This corresponds to having an error-free guard-space of g 
information and the associated g check symbols, ora total of 2g 
symbols. An error is undetected if and only if Equation 12.3 is 
satisfied. This is equivalent to 


E,, (X)f* (X) - BE, (X) g* (X) + Ey, (X)  (X) - E4(X) g¥ (X) = 0 


(12. 6) 


Now if g is equal to or greater than the degrees of f(Y) and g(Y), 
the first two terms in this equation will have degree less than e + g, 
while the last two terms will have X ° asa factor. Therefore 
Equation 12.6 is satisfied if and only if both 


and CEZA7) 
E,9(X) £*(X) - E_,(X) g*(X) = 


That is, a guard space consisting of g information and the g 
check symbols associated with them,where g is the larger of the 
degrees of f*(X) and g*(X), is sufficient separation between bursts 
to assure that if they would be detected individually they will both 
be detected if they both occur. 

This can be seen in another way. A syndrome different from but 
equivalent to that calculated in Figure 12.10 would be that calculated 
by the circuit shown in Figure 12.11. According to Equation 12. 3, 






Information 


Syndrome 


Check Symbols 





Figure 12.11. Analternate error detector 


the syndrome will be 0 if and only if no error or an error unde- 
tectable by the system shown in Figure 12.11 occurs. This de- 
tection circuit can be synthesized as a shift register with feed. 
forward but no feedback, and with g stages, where g is the 
larger of the degrees of f*(X) and g*(X), (See Figure 7.4.) Thus 
the occurrence of an error-free guard space of g information 

and the associated g check symbols completely fills the shift 
register with correct symbols, and the system acts after such a 
guard apace in the same manner ae if no errors had occurred at 
all, 
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Example: The polynomial 
g*(x) = (x> +x? + 1)(x? +xt+x? +x? +1) 
= xO tx? tx® xh txF 42941 


generates a binary Bose-Chaudhuri (31,21) code that has mini- 
mum weight 5. Therefore no multiple of g* (x) of degree less 
than 31 has fewer than 5 nonzero terms. The recurrent (2, 1) 
code that results when the encoder in Figure 12.10 is used with 
the transfer function 1/g(X) therefore detects any burst which 
affects 10 or fewer successive information symbols or any burst 
which affects fewer than 5 out of any 31 successive information 
symbols. In any case, Equation 12.4 must be satisfied by an 
undetectable burst. An error-free guard space of 10 information 
symbols and their associated 10 check symbols between bursts 
is sufficient. 

An encoder for this code is shownin Figure 12.12. Two alter- 
native error-detection circuits are shown in Figure 12.13. 
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Figure 12.12. Encoder for an example of a recurrent 
(2, 1) error-detecting code 
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Syndrome 
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Figure 12.13. Error-detection circuits for an example ofa 
(2, 1) recurrent code 


The analysis of the more general recurrent code is analo- 
gous to that for the (2, 1) recurrent code, For error de- 
tection it would usually be desirable to have fairly small 
redundancy, that is, a code in which for each n- 1 infor- 
mation symbols a single check symbol is transmitted, Such 
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a code in which the information symbols are transmitted un- 
altered is shown in Figure 12.14. Again the output marked 
"Syndrome!! will be 0 in the absence of errors and will 

depend on the error pattern only, incase there are errors, The 
condition for an undetectable error is that the syndrome be 0; that 
is, if E;(X) denotes the error pattern among the jth sequence of 
information symbols and E,(X) the error pattern among check sym- 


bols, then 


£*(X) £#(X) £1 &) ES ie atts 
arxy i) * carKy E,(X) +... oe me: .= as ) 


If, in particular, f*(X) = f¥(X) =... = fK-1(X), and £*(X), g*(X), 
., gX_1(X) are all relatively prime, then this can be written 
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Figure 12,14, Eneoder and error detector for 
an (n, ne« 1) recurrent code 
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E, (X)h(X)_—_-E, (X)h(X) Ej (X)K(X) EB (X)A(X) 
“Et Sepa gee ee (12.8) 
where 

h(X) = £*(X) g*(X). . - 8 | (X) (12.9) 


Every term on the left side of this equation is divisible by f, *(X), 
and therefore the right side must be divisible by f, *(X). But 
h(X)/£*(X) is relatively prime to £*(X), and theretare E,(X) must 
be divisible by £*(X). It can be shown similarly that each E;(X) 
must be divisible by g*(X). This isa necessary condition for an 
Serial acr aaa error, tad of the polynomials £*(X), ex (X) . 

Snot (X) is of degree at least b, then an undetectable error ech 
have to consist of a burst of length at least b + 1 among at least 
two sequences of information symbols or at least one sequence of 
information symbols and the check-symbol sequence. This would 
be a burst of length at least nb +2. Other conditions can be im- 
posed just as for the recurrent (2, 1) codes by choosing the poly- 
nomials £*(X), e(X), atts Siu ) &) as generators of cyclic codes 
with known einer ieaxrecting sisueriven, In every case it is neces- 
sary that Equation 12.8 be satisfied also. 


12.4. A Burst-Error-Correcting Recurrent Code Based ona 


Cyclic Code 


Let g*(X) of degree g be the generator polynomial of a cyclic 
(n, k) code that corrects all bursts of length b or less, and con- 
sider the recurrent (2, 1) code described in Fig. 12.15. The syn- 
drome will be all 0's unless an error occurs, and in that case the 
syndrome will be a function of the error pattern only. In fact, if 
the error pattern among information symbols is E 1!) and among 
check symbols E (X), then the syndrome is the ari as it would 
be if the information were all 0's; that is, 


S(X) = E,(X) - g*(X) E(x) (12. 10) 
If S(X) is divided by g*(X), the remainder equals the remainder 
after dividing E;(X) by g*(X). This is exactly the information re- 


maining after parity-check calculation with the cyclic burst-error 
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Figure 12,15. A burst-error correcting recurrent (2, 1) code 
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correcting code generated by g*(X), since the parity-check cal- 
culation for the cyclic burst-error-correcting code consists of 
dividing by g*(X). Therefore, given S(X), the complete deter- 
mination of the error pattern requires essentially the same cal- 
culation, and hence the same equipment, as is required for the 
error correction with the cyclic code. 

The above discussion assumes that the syndrome S(X) is known. 
In practice, it is known except for a factor X/ , because the time 
when the bursts start is not known. Let us assume that g*(X) gener- 
ates a cyclic code capable of correcting any burst of length b or 
less. If E;(X) and E,(X) are both assumed to have degree less 
than b (thatis, if the errors in information symbols and in check 
symbols occur at about the same time), then the starting time of 
the burst can be determined within limits. If g*(X) is of degree 
r, then the syndrome E,(X) + g*(X) E,(X) has degree less than 
r+b. There must be fewer than r 0's as low-order terms in 
the syndrome, for otherwise g*(X) E.(X) would have to consist 
of the sum of two bursts of length b or less, and this is impossi- 
ble, since g*(X) E¢(X) is a code word ina code that corrects 
bursts of length b. Thus the beginning of the syndrome precedes 
the first 1 by fewer than r symbols. 

The fact that these ideas can be used as the basis for a burst- 
error-correcting system is best illustrated by an example: It can 
be shown that the (15, 9) binary cyclic code generated by (1 +x+x? ) 
(l+x4+x*) =14+x? +x*+x° + x® corrects all bursts of length 3 
or less. (See Section 10.3.) The decoder of the type described in 
Section 10.5 is shown in Figure 12.16; the operation of this circuit 
is described in Section 10.5. 


Input 
15-Stage Buffer Storage or Delay 


Corrected Output 





Timing Signol ; {during Read-in, 0 during Correction 


Figure 12.16, Decoder for a (15, 9) cyclic code 


The recurrent (2, 1) code derived from this cyclic code can be 
mechanized with the circuit shown in Figure 12.17, In the error- 
correction system, errors cannot be corrected until the entire 
syndrome has entered the shift register. The function of the timing 
clock is to keep Gate | on and Gate 2 off, for b +r = 9 units of time 
starting with the first | inthe syndrome, to assure that the entire 
syndrome enters the shift register before any correction is attempt- 
ed, Then after the 9 unite of time allowed for the syndrome to enter 
the shift register, one "And! gate je turned off and the other turned 
on as soon ae the teat for Ola in the firet three stages of the ahift 
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register is met. At that time the error pattern is in the last three 
stages, and the erroneous information symbols are about to come 
out of the buffer. 
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Figure 12.17. Circuits for a recurrent (2, 1) code 


It is necessary for the timing clock to permit correction soon 
enough for the first error to be corrected. Errors should be cor- 
rected 15 symbols after they occur. The clock turns off the cor- 
rection circuits for 9 symbols, and it has been shown that the be- 
ginning of the syndrome has fewer than r = 6 0's. Therefore, 
after 15 symbols the correction circuits will not be turned off by 
the timing circuit, and correction will take place as it should. 

Correction is completed after 15 correct information symbols 
and their associated check symbols have entered the correction 
circuits. Thus a guard space of 30 symbols is sufficient if the 
first error-free symbol is an information symbol, 31 symbols if 
the first is a check symbol. 

This device has a greater guard~space requirement than a 
Hagelbarger code and at the same time requires more equipment, 
It is presented here because the concepts it involves are different 
and interesting, and because these ideas might be developed further 
into a practical system, 
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12.5. Sequential Decoding 


Wozencraft has made detailed studies of the use of recurrent 
codes in systems designed for correction of random errors using 
a system that he calls sequential decoding. 

Roughly, the sequential-decoding method decodes one information 
symbol at atime. The actual received sequence is compared with 
each sequence in the set of all possible transmitted sequences 
starting with a 1 and each sequence in the set of all possible 
transmitted sequences starting with a 0. Unless too many errors 
occur, the actual received sequence will differ from every sequence 
in one of these sets by so much that one can conclude that the actual 
transmitted sequence is the other set. Thus the first symbol is 
determined. This symbol is recorded, dropped from the sequences, 
and the test is repeated to determine the next symbol, and so on. 
The comparison of a hypothetical transmitted sequence with the 
received sequence need be carried only to the point where they 
differ enough to conclude that the transmitted sequence is incom- 
patible with the received sequence. 

Random-coding arguments indicate that the probability of error 
for sequential decoding can be made to approach 0 exponentially 
as the length of the coding shift registers is increased, and at the 
same time the length of the computation increases linearly. Simu- 
lation on a computer has been very promising. Details are given 
in Reference 121. 


NOTES 


Recurrent codes were studied first by Wozencraft!” »121 for random-error 


correction, and later by Hagelbarger*®? tag burst-correcting or detecting 
codes, and by Kilmer®® »®? for both cases. This chapter is based entirely on 
Hagelbarger's work, although some additional original material is included. 
The codes described in this chapter extend to the nonbinary case ina straight- 
forward manner. Wozencraft's sequential decoding methods have been gener- 


alized for nonbinary channels by Reiffen” » 141 , 




















Chapter 13 


CODES FOR CHECKING ARITHMETIC OPERATIONS 


The codes presented in this chapter differ from all those previ- 
ously treated in that all operations are ordinary arithmetic. These 
codes are practical: They can be used for data transmission with 
encoding and operations performed by a general-purpose computer, 
or they can be used to check the operation of anadder. There is 
an interesting similarity in structure to cyclic codes. 


13.1. Definition of 'Error'' and ''Distance" 


Numbers will be assumed to be represented as a polynomial in 
a radix r: 
eae egg erty N 
ok ae ne2? -+-Nr+N, (TSS 
where each digit Nj is less than r. The number is written 1 a 
Ny.~2--- N,N,. The important cases are the binary system, 
r = 2, and the decimal system, r = 10. 


Example: The binary number 


11010 = 1x 2* +412? +0x% 2% #1~%24+0 


which adds up to 26. The decimal number 382 means 3x 10? + 
Sx OF 2, 


The weight of a number N is defined as the minimum number of 
terms in an expression of the number in the form 


j Je 
a 1 
Nzaritar?+... (13. 2) 


where the a, may be negative or positive but are less than r in 
absolute value. The distance between two numbers N andN_ is 
defined to be the weight of the difference N - N, - If'a number 
N, is transmitted and N, # N is received, and if the distance 
between N, and N, is d, then a d-fold error is said to have oc- 
curred. Thus the occurrence of a d-fold error in a number N, is 
equivalent to adding to N, a number of weight d. Note that with 
these definitions distance depends upon the choice of radix r. 

It is not difficult to show that, just as with Hamming distance, 
a distance at least d between every pair of coded numbers is 
necessary and sufficient for detecting all (d - 1)- fold or smaller 
errors, For correcting any combination of t or fewer errors, 
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minimum distance 2t +1 is necessary, and more generally, cor- 
rection of any combination of t or fewer errors and simultaneous 
detection of d or fewer errors requires minimum distance t+d+l. 


Example: For the case r = 2, the distance between 171 and 203 

is 1, because 171 - 203 = -32=- 2°. The distance between 

17 and 32is 2: 17- 32 =-15=+2°-2*. For the decimal 

case, 1296 and 1183 are at distance 2, because 1296 - 1193 = 

1x 10? + 3x 10°. The distance between 1296 and 1305 is 1, even 

though they differ in three digits, because 1296 - 1305 =-9x 10. 

This definition of distance, which differs from Hamming distance, 
is mathematically more tractable than Hamming distance in the 
present context. It also matches more closely the types of errors 
that may occur in an arithmetic computer system. Clearly, ifa 
single digit is in error, this is a single error; andif d digits are 
altered, this is at most a d-fold error. Thus a system capable of 
correcting all d-fold or smaller errors in this sense corrects all 
numbers in which no more than d digits are altered. In an adder, 
however, a single error in one digit may cause several digits to 
be in error because of the influence of carries. Also a carry fail- 
ure may affect several digits. Such failures are still counted as 
single errors with this definition of distance! —™S 


It is not difficult to design a parallel binary adder for a computer 
in such a way that a single component failure in the adder will affect 
directly not more than one sum digit or one carry. A code that is 
single-error-correcting in the sense defined here would be capable 
of correcting for any single component failure in such an adder, 
even though because of carry propagation several digits in the 
result may be incorrect. 


Now consider a code in which the number N is represented by 
AN, where A is aconstant. Note that 


AN, + AN, = A(N, +N, ) (13. 3) 


so that the coded form for the sum of two numbers is the sum of 
the coded numbers. Therefore, coded numbers can be added in 
an ordinary adder; since the sum is properly coded, it may be 
checked or corrected. 

If A has the radix r asa factor, then so has every coded 
number AN. Ina radix-r representation, then, the lowest-order 
digit would always be 0 and would be useless. Similarly, if A 
and r are not relatively prime, certain digits are impossible in 
the low-order position, This is undesirable, and therefore it will 
be assumed that A and r are relatively prime, 

The analogy with eyelie codes is interesting. Inan AN codea 
number is a code numbers the coded form of some number if and 
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only if itis a multiple of A and in the accepted range of numbers. 
A polynomial is a code vector in the cyclic code generated by g(X) 
if and only if it is a multiple of g(X) of degree less than n. 

The number of digits required to represent N ina radix-r sys- 
tem is the smallest integer greater than log N. The number of 
digits required to represent AN is the smallest integer equal to 
or greater than log. AN = log. N+ log. A. The quantity log A 
will be called the redundancy for the code—the number of redundant 
digits actually required will differ by less than 1 from log. As 


Example: Ina 29N code with r = 2, the redundancy is log, 29 = 
4.8 bits. All numbers less than 2’ = 512 can be expressed in 
terms of 9 binary digits. To express 29N for all N less than 
2? in binary form, 14 digits are required. Thus 5 redundant 
digits are actually required. 

In a 3N code with r = 2, the redundancy is log 3= 1.6 bits. 
If a 3N code is used for binary representation of a decimal digit, 
then N < 10. To represent all numbers less than 10 in binary 
form, 4 binary digits are needed. Only 5 binary digits are re- 
quired to represent 3N in binary form, and thus only 1 redun- 
dant binary digit is actually required. 


Single-error detection requires that the minimum distance be- 
tween coded numbers be 2, that is, that no two coded numbers be 
a distance | apart. Thus, for all permissible N, and N,, 


A j 
AN, - AN, = A(N, - N,) # br (13. 4) 


where b <r. This can be assured by choosing A to be relatively 
prime to r and greater than r. The choice A=r+1 will always 
work. A 3N code will detect any single error ina binary repre- 
sentation, and 11N will detect any single error in a decimal rep- 
resentation. Thus single-error detection requires a fixed amount 
of redundancy for any given radix, no matter how large the num- 
bers N maybe. The redundancy required is log (r + 1), and this 
means that never fewer than 1 nor more than 2 extra digits will 
be required. This corresponds to the fact that a single parity sym- 
bol will detect single errors in ordinary linear codes, no matter 
how long the code is. 

Codes with minimum distance greater than 2 can best be de- 
scribed in terms of a number M,(A, d) defined to be the smallest 
number whose product with A has weight less than dina radix-r 
representation. 


Theorem 13,1. For any choice of A and r, if N is restricted 


either to the range 0 S N < M,(A,d) or to- } My(A,d - 1) < 
N <3 M,.(A,d), the AN code has minimum distance at least d, 


Proof: If N and N, are both within either range, N, - N, < 
M (A,d) and AN ~ AN, < AM,(A,d); and therefore, by the 
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definition of M_(A,d), AN, - AN, has weight greater thand - 1. 
rm 1 2 QED 


With the exception of Theorem 13.3 which follows, there is no 
way known of determining M;(A,d) except by exhaustive compu- 
tation. Some values are listed in Table 13.1 for the cases of most 
interest, r= 2 and d=3 or 4. 


Table 13.1. Some Binary AN Codes 
Distance-3 Codes Distance-4 Codes 


A M, (A, 3) A M, (A, 4) AM, (A, 4) 

11 3 43 3 2 +1 
13 5 51 5 2° aah 
19 27 89 23 2 a1 
23 89 105 39 aie whl 
29 565 153 215 215 4 27 mull. 
37 7085 185 1417 ae ai 
47 178481 267 15709 2ee el 
53 1266205 351 23905 273 4 2 2 i 
59 9099507 353 25249 2734 2°? at 
61 17602325 357 46995 20 fait 
67 128207979 393 181433 rae eke =e | 
71 483939977 547 245131 Zoli a9 Ties te 
79 6958934353 555 123818877 236 i 
83 26494256091 737 5967134431 7D gigs, UT ae Ih 
101 5099523830125 801 10981392159 2a ee ie 


103 11350134113449 


Theorem 13.2. An AN binary code has minimum distance 

3 for all numbers in the range 0 SN <M (or-M/2<N <M/2) 
if and only if the residues of + 2J modulo A are distinct and 
nonzero for all j such that 2) < AM. 


Proof: If the residues are all distinct, then a number of weight 
2, that is, a number of the form + 21+ 24, cannot have residue ioe 
and therefore cannot be the difference AN| - AN, between two 
coded numbers. Similarly, AN, - AN, cannot have weight 1 or 
0 (unless N =N,), and consequently the minimum weight must 
be at least 3. If, on the other hand, +2' and+2J have the same 
residue for some choice of i, j, and signs, then their difference 
D has residue 0 and so is of the form AN. It has weight 2. There 
must exist two numbers N and N, inthe specified range for 
which AN, - AN, = D, and hence the minimum distance is at most 
2. If the residue of #2! is 0, the minimum distance is easily 
shown to be 1. QED 


Theorem 13.3. If A is an odd prime and if 2 is a primi- 
tive element in the field of integers modulo A, 
A-1 


My, (A, 3) « ae + 1)/A (13. 5a) 
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If -2, but not 2, is primitive modulo A, 
A-1 


Heike ea Ge = fh (13. 5b) 


Conversely, if Equation 13.5a holds, A is prime and 2 isa 
primitive element modulo A, while if Equation 13.5b holds, 
A is prime and -2, but not i is primitive modulo A. 

Proof: If Ais prime, then 24 1 = ies (2(A-1)/2 ae elAali/e ~ 5 
= 0, and if 2 is primitive, 2(A- 1)/2 #1, so that 2(A- 1)) + 1-="0;5 "ox 
2(A-1)/2 = _ 1. Then the residues modulo A, are l, 2, 2?, 

2(A-3)/2 2(A-1) 2. = BL ee aire 15> 2(A- 3)/2, Then by Theorem 
yay Reason U3s 5a holds. 
A , “} (A- 3)/2 

If -2 is primitive and A prime, then l, 2, 2 Ate? 
must be distinct since their squares are. Abies none is equal to -l, 
for if 2) =- 1 modulo A for some j < (A-3)/2, then 22J = 1 = (-2)?4 
modulo A for pects 2j = A-3, which is impossible if -2 is primi- 
tive. Again { (2h ae ve. Giroypy /2 +1) =0 modulo A. If (A-1)/2 
is even, hy, +1) =0 modulo A. If (A-1)/2 is 
even, 2(A- We - if 1/2 # 1, hence 2(A-1 Wis -l. Then 2 is 
primitive,and Equation 13.5a applies. If, on the other hand, 
is primitive and 2 is not, then (A-1)/2 must be odd. , Then 2(A-1)/2 
-1 = 0, and the residues are 1, -2, 2?, , 2A-3)/2 1, 42, 
-27, ... , -2(A-3)/2 and by Theorem 13.2, Equation 13. 5b holds. 

Conversely, Theorem 13,2 implies that if Equation 13.5a or i 
13.5b holds, all the residues modulo A must be of the form + Pa? 
and A must be odd. Then 2, and therefore all the residues modaill 
A, are relatively prime to A, so that A must be prime. Then the 
residues modulo A forma field. The order of 2 is at least (A-1)/2, 
since the smaller powers of 2 have distinct residues. But the order 
of 2 must divide A-1, so it must be either A-1 or (A-1)/2. The 
same is true of -2. By Theorem 6.20, there is a primitive ele-. 
ment a. Ifthe orders of both 2 and -2 are (A-1)/2, then # 2? 
is always aneven power of a. This is impossible. Therefore, 
either 2 or -2 must have order A-l, i.e. be primitive. QED 


The codes given by Theorem 13. 3 are analogous to perfect single- 


error-correcting codes. A code to be used with numbers in the 
range 0 SN < 2™ (or ~2™-! < nN < 2™-1) must be able to distin- 
guish each of 2m possible errors and a correct coded number, 
2m + 1 possibilities in all. Theorem 13.2 states that each of these 
2m +1 possibilities corresponds to a different residue, and thus 
A2Z2m+1. Theorem 13.3 states necessary and sufficient condi- 
tions for the equality to hold. Note the analogy with cyclic codes, 
In an AN code, not only must A be prime, but 2 must be a primi- 
tive element. For a binary cyclic Hamming code, the generator 
polynomial g(X) must not only be irreducible, but its roots must 
be primitive. 

All the distance-3 codes listed in Table 13,1 are of the type 
deacribed in Theorem 13, 3, 
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13.3. Self-Complementing AN + B Codes 


For some purposes it is desirable that the code for the complement 
of a number be the complement of the code for that number. If the 
numbers to be coded have a base b, then the complement of N is 
defined to be b-1-N. If the coded numbers are represented as n- 
digit numbers with radix r, then the complement of ANis r™- 1 - AN. 
The requirement that the code of the complement of a number be the 
complement of the coded number is 


r"- 1-(AN+B) = A(b- 1-N)+B (13. 6) 
This equation can be solved for B: 
etqr, = 1 = Afb ~.1)) (13. 7) 


A self-complementing code is possible if and only if Equation 13.7 
yields an integral value for B. 

An AN + B code has the same distance properties as the corre- 
sponding AN code, for (AN, + B) ~ (AN, + B) = AN, - AN, 


Example: Suppose that a binary AN + B single-error-correcting 
self-complementing code for decimal digits is required. Table 
13.1 shows that the smallest value of A yielding an AN code with 
M, (A, 3)2 10 is A=19. For this code the largest coded number 
will be at least 19 x 9 = 171, and so will require at least n = 8 
binary digits. Equation 13.6 yields B = 42, and since 19 x 9+42= 
223 < 28, this code is possible. The coded form of the digits is 
as follows: 


0 0;0,15 6.1, 0 1.0 5 10001001 
1 0. Ode tok L Ord 6 102 0g); 41. de 0uO 
2 0140), 0,0; 0.0 7 SLO es Dato ge he en Bo | 
3 Op atO GO) 'O.1) al 8 Lely 0090205140 
4 OFT LO.d 10 9 Lvle Odile 0-1 


Three other codes, 23N + 24, 25N+ 15, and 27N + 6, also meet 
the basic requirements with an 8-binary-digit code.'5 


1354; Implementing AN and AN + B Codes 


If a computer is available, the obvious way to encode for an AN+B 
code is simply to multiply the uncoded number N by A and add B. 
To decode, one simply subtracts B from the received coded num- 
ber and divides by A. A nonzero remainder indicates that an error 
occurred; and the value of the remainder is characteristic of the 
error number, which is the difference between the received coded 
number and the most likely transmitted coded number (see Theorem 
13,2 and Problem 13.1), Table look-up, with a table that lists the 
appropriate error number for each possible remainder, would usually 
be the most expedient way to handle error correction in a computer, 

Error correction for the "loaslesa' AN codes deseribed in Theorem 
13, 3 can be implemented in @ manner analogous to that deseribed for 
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Figure 13,1. A shift register with shift multiplying by 2 modulo 19 


cyclic Hamming codes in Section 8.7 The first stepis to designa 
shift register that multiplies by 2 modulo A upon shifting. Such 

a device for A = 19 is shown in Figure 13.1. If shifting would result 
in shift-register contents as great as 19, that is, if the shift-register 
contents are 10 or greater or 9 witha 1 as input, then 19 should be 
subtracted from the shift-register contents at the same time that 
shifting is done. Subtracting 19 is the same as adding 32 - 19 = 13 
in a 5-digit binary adder. If the ''test for 10 or greater" gives a 

1 as its output, then 13, whichis 01101 inbinary, is added into 
the register as itis shifted. 


The residue of a number modulo 19 can be found by shifting the 
number, represented in binary, into this shift register, high-order 
digits first, until the lowest-order digit enters the register. The 
residue remains in the shift register. 

Correction can be accomplished by shifting the register with no 
input until +1 or -1 (which appears as 19 - 1 = 18, or in binary 
1001 0) appears in the shift register, and keeping track of the 
number of shifts required. If the error occurs in the jt -order 
digit, the error is +2J, Since 2 is primitive modulo 19, 2? =- 1, 
and therefore if an error + 24 occurs, - 1 appears in the shift regis- 
ter after 9 - j shifts; while if the error is - 2), then+ 1 appears in 
the shift register after 9 - j shifts. Thus the error position can be 
determined from the number of shifts, and whether the error was 
+2) or -2) determines whether +1 or -1 shows up first in the shift 
register. The details of the circuit can be organized as for cyclic 
Hamming codes or cyclic burst-error-correcting codes, but witha 
serial adder and subtracter for adding or subtracting the correction, 


13.5. Separate Adder and Checker 


It is often desirable to have the coded words in a checking sys-~ 
tem consist of unaltered information digits with check symbols, as 
they do in systematic linear codes. If such a system is used for 
checking an adder, it is also desirable that the adder and the equip« 
ment which processes check symbols be completely independent, 
to avoid the possibility that the failure of a single component might 
affect both the sum and the check symbol in #uch a way that an 
error is undetected or not properly corrected, In this seetion it 
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is shown that if the adder and checker are independent, the check 
symbol for a number must be either a duplicate of the number (pos- 
sibly differently coded), or for some b the modulo b residue of 
the number in some code. Furthermore, it is shown that to every 
AN code there corresponds a modulo A code with the same mini- 
mum distance and essentially the same redundancy. 

Consider the system shown in Figure 
13.2, in which C(N) designates the 
check symbol associated with N and 
cin) poe BN ees ec * denotes the operation done by the 
omy ne checker. It is required that the output 

of the checker be consistent with the 


i ie 7 ee 
hina de sree output of the adder; that is, 


with separate adder and 
checker. C(N,) * C(N,) = C(N, + N,) (13. 8) 


This constraint on the code restricts it to a very special type. 


Theorem 13.4. If there are fewer check symbols than integers 
in the permissible range of integers, and if the check symbols 
C(N) satisfy Equation 13.8, then C(N) must be the residue of 
N modulo some base b ina coded form, where b is the num- 
ber of distinct check symbols, and * is addition modulo b. 


Proof: Let S denote the set of allintegers N that have the 
same check symbol as 0; that is, C(N) = C(0). The first step in 
the proof is to show that S is an ideal in the ring of integers. By 
definition, 0 isin S. Note that C(0) = C(O + 0) = C(0) * C(0), and 
therefore C(0) * C(0) * ... * C(0) = C(0), no matter how many 
factors appear on the left. Thus if 'a''is in S, thenNa=at+...¢a 
isin S, for 


GC(\Na)i = Gla tai pals tha)) = Claji® Gla) Fax ay. -* Cla) 
C(O); Clo) * 0... = C0) = C(0) 


N 


Also if "a''isin S 


C(- a) 


C(O = a) = C(0) * C(-a) = Cla) * C(-a) 
C(a - a) = C(0) 


and therefore - a isin S also. Thus S is an ideal. 
Next, note that C(N, ) = C(N,) if and only if N, and N, are in 
the same residue class of S. This is shown as follows: 


C(N,) = C(N,) * C(N, = N,) 


If N, and N, are in the same residue class, Nye» N, is in S and 
C(N, - N,) = C(0). 


C(N,) = C(N,) * C(0) = C(N, +0) = C(N,) 
On the other hand, if C(N,) # G(N,), then 
C(N, =N,) * G(N,) * G(=N,)@ GON,) * G(= N,) # GCN, = Ny) ® C(O) 
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and so N, - N, is in the ideal S, and N, and N, are in the same resi- 
due class of S. Note that this means that if two different integers 

N, and N, have the same check symbol, then the ideal S is non- 
trivial, for then C(0) = C(N, - N,), and thus the ideal contains more 
than just the number 0. 

By Theorem 6,2, Sis a principal ideal; that is, it consists of all 
multiples of some integer b. The residue classes are residue 
classes modulo b. Thus there is a one-to-one correspondence be- 
tween residue classes and check symbols. For every j, 03 j <b, 
consider C(j) to be the code for the residue class containing j; that 
is, define C(j) = j. Theni* j = C(i) * C(j) = C(i+ j) = i+ j modulo 
b, and thus the checking operation is addition modulo b. QED 


If there are as many check symbols as numbers, each number 
has a distinct check symbol, and the checker is equivalent to a 
duplicate adder. 

Next consider an AN code with certain distance properties in a 
radix-r system. Let m be the smallest integer equal to or greater 
than log A. Then every integer less than A can be expressed as 
an m-digit number with radix r. Consider the | code in which the 
check symbol C(n) for N is the residue of -r ™N modulo <A: 


-r™"N = Aq + C(N) 
Then the number formed by adding C(N) to rN is 


r''N+C(N) = = Aq 


which is a multiple of A, and therefore is a code number in the AN 
code, Butr N+ C(N) as a radix-r number has the digits of N as 
its high-order digits, and the digits of C(N) as its low-order digits. 
Thus the distance between two words, each consisting of a number 
and its check symbol, is at least the minimum distance of the AN 
code. In particular, single-error detection can always be accom-~ 
plished by taking C(N) as the residue of - x? N modulo r + 1, and 
the values of A givenin Table 13.1 can be used to form single- 
error-correcting and single-error-correcting, double-error- 
detecting check-symbol codes. 

These codes are of the type specified by Theorem 13.4, with the 
radix-r representation of the residue of =r j taken as the code 
for j. It is interesting also to note the analogy with the encoding 
method for cyclic codes described in Section 8.5. 


NOTES 


This chapter is based on D. T. Brown's work, 15 which in turn is based on 
a short paper by Diamond.?3 Theorem 13.4 is taken from Reference 85. 
Analogous results for logical rather than arithmetic operations have been 
found by Elias’? and Peterson and Rabin. 89 Codes with residue-class check 
symbols have been proposed by Garner” The distance-3 codes in Table 13. 1 
were found by Brown!® and the distance-4 codes were found by John Selfridge, 


PROBLEM 


14, 1, Show that every diatinet correctable error in an AN code muant have 
a diatinet residue modulo A, 
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INEQUALITIES INVOLVING BINOMIAL COEFFICIENTS 


This appendix contains some inequalities useful in estimating 
expressions containing binomial coefficients. The material is 
taken from class notes for an information theory seminar given 
by C. E. Shannon at M.I. T. 


Let 
1 fs = 
Ginicgdunete og PO (A. 1) 
N27 
Then 
G exp - pak 9 Sas? ate ra ag < 
eu Vitne © Tesh me aie siti 
and 
1 n 


where 4 =1-} and neither \ nor yp» is 0. 
These two inequalities can be proved using the Stirling approxi- 
mation: 


n! aio nint2) Pe a ox (Ti svsertbaen ae 
360n? 


It is known (Reference 36) that n! is underestimated if no terms 

of the series are taken; n! is overestimated if only the 1/12n 

term is taken; and so forth. An overestimate of (.” ) = n!/(An)! (un)! 
is obtained by using Equation A. 4 as an underestimate of (Xn)! and 
(yn)! and the same expression with the term (-1/360n?) omitted 

as an overestimate for the numerator. This gives 


n! 
(An)! (un)! 
1 1 1 1 1 it i 


<< exp | ee St st 
An pn len, l2Xn 12 
Tkp yh HP 360(An)?—-360(yn)? 


The expression is symmetric in \ and pp» Suppose that X = uy. 
Then 
1 | = i 


s 
360(xn)’ -360(un)? 80h 
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and 
l 1 
—_— < 
12n 12dn 
Thus 
1 1 ip 1 1 


SS ee + ———_—_——_- + ————_—_—_. 
360(An)? 360 (un)? 


1 1 1 1 


Via? T2ie ide Teegn* 
This proves the upper bound, Inequality A.2. The lower bound is 
found similarly by using Equation A. 4 with one term in the series 
as an upper bound for the denominator and with no terms in the 
series as a lower bound for the numerator n!. 
The other lower bound, Inequality A.3, follows from Inequality 
A.2 unless both X\n and yn are less than 3, since then (1/12Xn) + 


(1/12un) is less than (1/12) + (1/36) = (1/9) and exp (-1/9) > (1/2)Nt. 


For the four cases in which \n and yn are both less than 3, the 
result is easily verified. The case \n=1, pn=1 gives equality. 
The "tail"! of a binomial distribution may be estimated by the 

following formulas 


n 





(vn) p»Topn yr \ (le igs 
Xn i 
i=\n 
AQ n An wn : 
ax>P 
< os (3) Py, @ provide 
(A. 5) 
where Q=1-P. Also 
n 
ahs f 4 , > 
= (") pig™iz, Pty pnp An oun provided } > P 
=An (A. 6) 
Letting P= Q= 5 and multiplying both sides by 2” give 
n 
n\ < \ D\ ~ kf 2) iooteen 3 Oe 
An 1)” BES 1 end, © eee i 
i=\n 
and 
n 
n “An -pn ; 1 
i Si pe provided \ > 3 (A. 8) 


i=An 
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The lower bound in Inequality A.5 is obvious. The upper bound 
is found by overbounding the sum by a geometric series. (See 
Reference 36.) The bound, Inequality A.6, is a special case of 
the Chernoff inequality (Reference 19). For more precise, more 
general results see Reference 35. 

A sum of the form 


> (+ 


can be estimated by letting P = 1/(a+ 1), Q=a/(a+ 1) and noting 
that 


An m 
> (?) as (a + 1)” ) (?) gig 
i=0 i=0 
n 
= (a+1)” ) (") vgn! (A. 9) 
izn-m+l 


Each of the Inequalities A. 4 to A.7 consists of some factors not 
strongly dependent on and a factor F| or 2 P'"Qh” The 
binomial coefficient can be estimated using Equation A.1 and 
Inequalities A. 2 and a , and the dominant factor in these expres-~ 


sions is Xp P". In calculations with large values of n, the 
following forms are useful: 

- log ONTO) ok dog =p loge « HOY (A. 10) 
where 

H(x) = -x log x - (1 - x) log (1 = x) (A. 11) 
and 


1 - « 
-= log (A ME We ht pe wih). ~ &ldg P-p bog G 


= -H(\) + H(P) + (P ~ 2) log P + (u - Q) log Q 


But pp - Q=-(P =), and Se). = H' (x) = log (3), and there- 


fore = 
1 1 “An pn Anu 
= log (OPM ph ™ » EQ, P) (A. 12) 
where 
E(\, P) © HCP) + (\ ~ PYM (P) © MA) (A. 13) 
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A SHORT TABLE OF THE ENTROPY FUNCTION (BASE 10) 
This expression can be given an interesting geometrical inter- AND ITS FIRST DERIVATIVE 
pretation, as shown in Figure A.1. P H  DH/DX P H —_DH/DX P H  DH/DX —P H  DH/DX 


i eA ld regardless of the base of the loga~ 
Ss ae ak ade ln he 8 8 00001 200005 540000 0001 200044 460000 001 00343 269996 01 002432 129956 


rithms, provided only that the same base is used in all equations. 00002 £00010 46990 0002 200083 346989 002 000627 266981 02 «04258 166902 

culated with common (base 10) logarithms is given 00003 200015 4¢5229 0003 000119 365227 003 000887 265216 03 «05852 105097 
Pe PREES Caie Carenies : ( Ud; s 00004 400019 463979 0004 200153 343978 004 001133 263962 04 «07294 163802 
in Appendix B. Longer tables, which use base 2 logarithms, are 00005 400024 43010 0005 400187 343008 005 01367 262989 05 .08621 162788 
given in References 24 and 33, 00006 400028 42218 0006 200219 3462216 006 001593 262192 06 «09857 101950 


00007 200032 461549 0007 200251 341546 007 001811 261519 O7 011015 101234 
00008 400036 4.0969 0008 200282 340966 008 002024 240934 08 «12107 140607 
00009 400040 44.0457 0009 400313 340454 009 002230 240418 09 013139 140048 
00010 600044 4.0000 0010 600343 249996 010 002432 149956 10 014118 029542 


00011 600048 349586 0011 200373 249581 O11 602630 149538 11 615049 09080 
00012 600052 329208 0012 200403 2469203 012 002823 149156 12 015935 028653 
00013 200056 368860 0013 600432 228855 013 603013 148804 13 016781 008256 
00014 200060 348538 0014 200460 248533 014 003199 168477 14 017587 007884 
00015 600064 368238 0015 200489 248233 015 003382 168173 15 018358 007533 
00016 200068 3.7958 0016 200517 247952 016 203563 1.7889 16 019095 007202 
00017 200071 347695 0017 200545 2.7688 017 603740 167621 17 019799 006886 
00018 200075 367447 0018 200572 247439 018 203915 167368 18 020472 006585 
00019 200079 347212 0019 200599 2467204 019 004088 147129 19 021116 006297 
00020 00083 3.6989 0020 200627 246981 020 604258 146902 20 021732 006021 





00021 «00086 346777 0021 600653 26769 O21 004426 146686 21 022321 005754 
00022 200090 346575 0022 «00680 246566 022 004592 146479 22 022883 005497 
00023 600094 3.6382 0023 000707 266373 023 004755 146282 23 023420 005248 
00024 200097 366197 0024 «00733 26187 024 004917 146092 24 023933 0205006 
00025 200101 366020 0025 600759 246010 025 ¢05077 1465911 25 024422 004771 
00026 600105 345849 0026 200785 245839 026 005235 105736 26 024888 004543 
00027 200108 345685 0027 200811 265675 027 005392 145567 27 025331 004320 
00028 200112 365527 0028 600836 245516 028 605547 145405 28 025752 004102 
00029 400115 345375 0029 200862 245363 029 005700 1465248 29 026151 003889 
00030 200119 365227 0030 200887 265216 030 005852 145097 30 026530 003680 





00031 200122 345085 0031 200912 245073 031 006002 164950 31 026887 003475 
00032 600126 364947 0032 600937 244935 032 606151 164807 32 027225 003274 
00033 600129 344813 0033 «00962 244801 033 006298 144669 33 027542 003076 
00034 600133 364684 0034 200987 244670 034 006444 144535 34 027840 002881 
00035 200136 364558 0035 2001011 244544 035 606589 144405 35 028118 002688 
00036 600140 344435 0036 001036 244421 036 606732 164278 36 028378 002499 
00037 200143 364316 0037 001060 244302 037 006874 144154 37 028618 002311 
00038 600146 344201 0038 001084 244186 038 607015 164034 38 028840 002126 
00039 200150 344088 0039 001109 264072 039 007155 143917 39 029043 001943 | 

00040 200153 3.3978 0040 601133 243962 040 «07294 143802 40 029229 001761 ! 





00041 200157 343870 0041 201156 243854 041 «07431 143690 41 029396 001581 
00042 600160 343766 0042 201180 243749 042 «07568 143581 42 029545 001402 
00043 200163 343663 0043 001204 243647 043 207703 143474 43 029676 001224 
00044 600167 343564 0044 601228 243546 044 207837 143370 44 029790 001047 
00045 400170 343466 0045 001251 243448 045 207970 13268 45 029885 000872 
00046 600173 343370 0046 001274 243352 046 208102 143168 46 0629964 020696 
P X > 00047 200177 343277 0047 001298 243259 047 208234 143070 47 630025 000522 

= 00048 400180 343186 0048 601321 263167 048 208364 142974 48 030068 000348 





00049 400183 363096 0049 601344 243077 049 608493 162880 49 «30094 000174 
Figure A.1. Geometrical interpretation of E(\, P). 00050 400187 343008 0050 401367 242989 050 «08621 162788 50 «30103 0e0000 


00051 200190 342922 0051 601390 242902 O51 608749 142697 
00052 400193 342838 0052 601413 262817 052 «08875 142608 
00053 600197 342755 0053 001436 202734 053 209001 1462521 
00054 2.00200 342674 0054 601458 262653 054 0609126 162435 
00055 400203 342594 0055 601481 262572 055 009250 142351 
00056 200206 342516 0056 201804 262494 056 609373 142268 
00057 200210 342439 0057 0601526 22416 O57 609495 142186 | 
00058 600213 362363 OO5H 201548 262940 O58 609617 1462106 | 
00059 200216 462789 0059 01571 202266 O59 eO9797 1e2027 

00060 600219 362216 0060 601999 2e2192 060 609857 1461990 
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Appendix C 


TABLES OF IRREDUCIBLE POLYNOMIALS OVER GF(2) 











From the following tables all irreducible polynomials of degree 
16 or less over GF(2) can be found, and certain of their properties 
and relations among them are given. A primitive polynomial with 
a minimum number of nonzero coefficients and polynomials be- 
longing to all possible exponents is given for each degree 17 
through 34. 

Polynomials are given in an octal representation. Each digit in 
the table represents three binary digits according to the following 
code: 

0 000 2: 0 1 6 4 100 6 J 20 
1 001 2 6 OT. 2 5 1 @: 1 4 ) ae ie | 
The binary digits then are the coefficients of the polynomial, with 
the high-order coefficients at the left. For example, 3525 is listed 
asa 10th - degree polynomial. The binary equivalent of 3525 is 
0141101041041 01, and the corresponding polynomial is 
xt? + x9 + xo 4 xo + Xt +X? +1. 
The reciprocal polynomial of an irreducible polynomial is also 
irreducible, and the reciprocal polynomial of a primitive poly- 
| nomial is primitive. Of any pair consisting of a polynomial and 
its reciprocal polynomial, only one is listed in the table. Each 
entry that is followed by a letter in the table is an irreducible 
polynomial of the indicated degree. For degree 2 through 16, 
these polynomials along with their reciprocal polynomials com- 
prise all irreducible polynomials of that degree. 
The letters following the octal representation give the following 


information: 


A,B,C,D Not primitive 

E,F,G,H Primitive 

A,B,E,F The roots are linearly dependent 

C,D,G,H The roots are linearly independent 

A,C,E,G The roots of the reciprocal polynomial are linearly 
dependent 

B,D,F,H The roots of the reciprocal polynomial are linearly 

independent 


The other numbers in the table tell the relation between the poly- 
nomials, For each degree, a primitive polynomial with a mini- 
mum number of nonzero coefficients was chosen, and this polynomial 
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is the first in the table of polynomials of this degree. Let a denote 
one of its roots. Then the entry following j inthe table is the 
minimum polynomial of a. The polynomials are included for 

each j unless for some i < j either a? and aj are roots of the 
same irreducible polynomial or at and a°J are roots of the same 
polynomial. The minimum polynomial of aj is included even if it 
has smaller degree than is indicated for that section of the table; 
such polynomials are not followed by a letter in the table. 


Examples: The primitive polynomial (103), or X° +X+1= p(X) 
is the first entry in the table of 6th. degree irreducible polyno- 
mials. If a designates a root of p(X), then a° is a root of 
(127) and a® isa root of (147). The minimum polynomial of 
a? is (015) = X? + X* +1, and is of degree 3 rather than 6. 
There is no entry corresponding to a’? The other roots of 
the minimum polynomial of a’ are a®*, a®® = a®, a®, a2, 
and a*°. Thus the minimum polynomial of a!” is the same as 
the minimum polynomial of a°® , or (147). There is no entry 


corresponding to a3. The other roots of the minimum poly- 


nomial p,, ot co axe oh \a™ a7 a*! , a* = a!?, and 
a®, None of these is listed. The roots of the reciprocal poly- 
nomial p,,*(X) of p,,(X) are a*? =a°°, a % =a%, a5? = 

rb, ol Bor SEALS 0 lied sh ace -38 25 rae 

a a ein ay ns 9 iy ge AOR, =a. The minimum poly- 
nomial of a! is listed as (155) or X* + X® +X? +x? +1. The 
minimum polynomial of a’? is the reciprocal polynomial of this, 


or p,,(X) = x° +xX*4xX?4X41. 


’ 


The exponent to which a polynomial belongs can be found as 
follows: If a is a primitive element of GF(2), then the order 
e of ga is 


ude = W/OCIES a ko ae 


and e is also the exponent to which the minimum function of a 
belongs. Thus, for example, in GF(2)°), a°> has order 93, since 


93 = 1023/GCD (1023,55) = 1023/11 


Thus the polynomial (3453) belongs to 93. 

Marsh’® has published a table of all irreducible polynomials of 
degree 19 or less over GF(2). In this table the polynomials are 
arranged in lexicographical order; this is the most convenient 
form for determining whether or not a given polynomial is ir- 
reducible. 

For degree 19 or less, the minimum-weight polynomials given 
in this table were found in Marsh's tables. For degree 19 through 
34, the minimum-weight polynomial was found by a trial-and-error 
process in which each polynomial of weight 3, then 5, was tested, 
The following procedure was used to test whether a polynomial 
f{(X) of degree m is primitive, 
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m-1 

l. The residues of l, X, EA em ees x* are formed 
modulo f(X). 

2. These are multiplied and reduced modulo f(X) to form the 
residue of X o If the result is not 1, the polynomial is rejected. 
If the result is 1, the test is continued. 

3. For each factor r of ore 1, the residue of X” is formed by 
multiplying together an appropriate combination of the residues 


formed in Step 1. If none of these is 1, the polynomial is primitive. 


Each other polynomial in the table was found by solving for the 
dependence relations among its roots by the method illustrated at 
the end of Section 8.1. 4 


Table C.1. Factorization of 2™ _ 1 into Primes 


(Ded en Viera 2}9 _ 1 = 524287 

oie l= S5a05 2° _1=3x%5x5x 11x 31x 41 

Zoe aed a3 2S = TOS 337 

Zeeks = Siena sey, 27% _ 1 = 3x 23x 89x 683 

2h oglhre: Li2e, 273 - 1 = 47x 178481 

2h S355 17 2% 1 = 3% 3x 5x 7x 13x 17x 241 
27 eal ST Se TS 24. 1 = 31x 601x 1801 

2m el i= Sheltie 31 2% - 1 = 3~x 2731x 8191 

2 = 235689 27 ~ 1 = 7x 73x 262657 

22. 1=3x3x5x7x 13 27 1 = 3x 5x 29x 43x 113x 127 
233-1 = 8191 279 - 1 = 233x 1103 2089 

24 - 1 = 3x 43x 127 2° ~ 1 = 3x 3x 7x 11x 31x 151x 331 
revel = 7 56 Sls 1511 232 _ 1 = 2147483647 

26 2. 1 = 3x 5x 17x 257 237 _ 1 = 3% 5x 17x 257 x 65537 
28 2 T= 131071 233. 1 = 7x 23x 89x 599479 

2° 1 = 3x 3x 3x7xX19x%73 234-1 = 3x 43691 131071 
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587 
603 
619 
659 
675 
691 
715 
71 
798 
419 


10213B 
14111A 
10321E 
14433F 
12753F 
13425E 
15723F 
16401C 
177770 
16003¢ 
10467B 
14043D 
10077B 
10743B 
14545G 
17147F 
00133 


23261E 
2t200G 
31425G 
33763H 
30417H 
26533F 
27203F 
30711G 
31303H 
27217F 
27051E 
36375G 
36403H 
24703F 
37145G 
2taS Tr 
25955E 
27421E 
22307F 
36721G 
26341E 
23267F 
25245E 
34517H 
20157F 
22631E 
31333H 
36667H 
23563F 
35315G 
22455E 
21525E 
34261G 
22705E 
30777H 
37243H 
35057H 
31113H 
26215E 
22051€ 
540456 
26219F 
34413 
592716 
aa7ovr 
paar 
NOOTSH 


173 
185 
201 
213 
22% 
273 
285 
301 
325 
341 
357 
397 
421 
437 
589 
661 
ELT, 


17 

29 

41 

53 

65 

77 

89 
101 
bl 
125 
141 
153 
165 
207 
189 
205 
217 
229 
241 
269 
281 
297 
309 
S28 
337 
349 
365 
card 
401 
413 
429 
44] 
461 
473 
553 
569 
589 
605 
621 
661 
677 
695 
17 
735 
Hos 
02) 


12247E 
14037A 
14067D 
16457D 
13431E 
00023 

17141A 
12315A 
00163 

11561E 
15347C 
aZEz TF 
14271G 
12623F 
16311G 
10605E 
16571C 


24623F 
Stacie 
37505G 
25745E 
32517H 
33343H 
2120s 
32641G 
220ecr 
33741G 
35477H 
22675E 
35567H 
33163H 
31327H 
31035G 
30357H 
20363F 
33441G 
34363H 
31653H 
34005G 
31407H 
26225E 
371516 
26617F 
31071G 
34767H 
36037H 
32231G 
33705G 
36465G 
33405G 
37123H 
37653H 
275 15E 
24315E 
36023H 
21211E€ 
22127F 
27227F 
26775E 
22097F 
874456 
aoi7or 
2o707F 
991216 


175 
187 
203 
215 
aa) 
215 
rae dh 
307 
327 
343 
359 
403 
423 
439 
595 
683 
819 


19 

31 

43 

55 

67 

<2 

91 
103 
115 
131 
143 
155 
167 
179 
195 
207 
219 
23% 
243 
271 
283 
299 
311 
B27 
339 
355 
367 
391 
403 
419 
431 
443 
463 
475 
555 
LAB! 
595 
611 
627 
663 
679 
695 
123 
749 
Hoy 
Hes 


16757D 
14613H 
13157B 
10653B 
10167B 
14601C 
15775A 
14221E 
Li2330 
12673B 
11075E 
14373D 
14313D 
12007F 
13413A 
10737F 
00037 


23517F 
35051G 
36515G 
36575G 
37335G 
33727H 
24513F 
24657F 
34627H 
37611G 
34151G 
36073H 
23167F 
32757H 
2722 18 
24763F 
33037H 
33501G 
33643H 
21673F 
37511G 
34555G 
33471G 
35561G 
24667F 
20275E 
23353F 
34341G 
31267H 
32207H 
37621G 
33013H 
34655G 
27111E 
24325E 
32137H 
24727F 
27373F 
20311E 
23621E 
22561E 
326356 
906516 
2a7i7r 
2ise7r 
967716 
477516 


Ar: 
189 
205 
ane 
233 
OUT. 
293 
309 
329 
345 
361 
405 
425 
441 
597 
685 
1365 


9 
21 
33 
45 
57 
69 
81 
93 

105 
ULy 
133 
145 
157 
169 
181 
197 
209 
221 
233 
245 
272 
285 
301 
313 
329 
341 
a57 
369 
393 
405 
421 
433 
453 
465 
477 
$57 
581 
597 
613 
629 
665 
681 
697 
725 
T41 
Hoo 
Hes 


255 


16017C 
13535A 
14513D 
13563B 
11313F 
16021G 
11477F 
11763B 
11637B 
14537D 
16363F 
130038 
14155C 
15353D 
12265A 
16355C 
00007 


30741G 
34723H 
26077F 
26653F 
25327F 
2t2TLe 
32311G 
32437H 
PEW ey tS 
23077F 
27405E 
35121G 
36217H 
23761E 
25577F 
20245E 
34401G 
20425E 
24165E 
32167H 
23003F 
24205E 
22613F 
25663F 
383256 
36625G 
26243F 
34547H 
2713a3F 
26101E 
21405E 
27531E 
32173H 
35455G 
31251G 
26743F 
30331G 
20737F 
34003H 
24465E 
21615E 
33631G 
26565E 
26505E 
25161€ 
S7927H 
S882an 























256 


DEGREE 13--CONTINUED 


839 
855 
875 
1395 
1235 
1355 


26415E 
eal ye Boas 
21067F 
27411E 
34243H 
330456 


DEGREE 14 


11 

23 

35 

47 

59 

via 

83 

95 
107 
119 
131 
143 
Tea 
167 
179 
191 
203 
215 
227 
239 
251 
271 
283 
295 
307 
323 
335 
347 
359 
37L 
387 
399 
411 
423 
435 
451 
463 
475 
487 
531 
547 
559 
571 
587 
599 
615 
627 
647 
659 
675 
687 
699 
Tis 
Tan 
743 
755 
791 


40503F 
45145E 
64167F 
70423H 
40725E 
674256 
53705E 
45627F 
655516 
52215E 
61335G 
650016 
41625E 
45713F 
6STSSE 
50645E 
42777F 
42301A 
45511E 
terre 
60263H 
60057H 
646356 
54101E 
45563F 
40635E 
73107H 
52723F 
TUZISE 
52027F 
00253 

40145A 
70065C 
62261C 
61053D 
73071G 
42763F 
65165E 
57627F 
55247B 
54243F 
640530 
77057G 
50135E 
53051E 
73603D 
505578 
47233F 
46565E 
51565A 
52627A 
45257B 
70461G 
46107F 
66163F 
43317F 
757616 


841 
857 
877 
1197 
1237 
1357 


k 
rs 
25 
37 
49 
61 
73 
85 
oF 

109 
121 
133 
145 
157 
169 
181 
193 
205 
217 
Zar 
241 
261 
273 
285 
297 
309 
325 
337 
349 
361 
373 
389 
401 
413 
425 
437 
453 
465 
477 
489 
bee) 
549 
561 
573 
589 
601 
617 
629 
649 
661 
677 
689 
701 
717 
729 
745 
781 
793 


2373 7F 
35777H 
25TS1E 
20457F 
Z12Sde 
24253F 


42103F 
77141G 
76303G 
60153F 
47153F 
42667F 
42163F 
40123E 
67335G 
43017F 
44177F 
43161E 
54335E 
44435E 
75267H 
63015E 
72433F 
47203F 
51145E 
42637F 
56557F 
53043B 
54473A 
64475C 
65645A 
5O0717A 
46113E 
42727F 
42323F 
44031E 
45201E 
60765G 
63265G 
WSS 27F 
SOS TSE 
45371E 
52553B 
52261A 
44037B 
57251A 
56171E 
62055C€ 
41551A 
41105A 
67737H 
61555G 
47525E 
45725E 
53015E 
44141E 
76267H 
70665G 
45311E 
47513B 
65007A 
TOT67G 
77031G 
600756 


843 
859 
1171 
1203 
1323 
1363 


15 
27 
39 


63 
75 
87 
99 

111 
123 
135 
147 
159 
171 
183 
195 

207 

219 

231 

243 

263 

275 

287 

299 

311 

327 

339 

351 

363 

375 

391 

403 

415 

427 

439 

455 

467 

479 

491 

535 

551 

563 

579 

591 

603 

619 

631 

651 

663 

679 

691 

707 

719 

731 

747 

783 

795 


25425E 
32725G 
2¢Si3F 
21557F 
Za RISE 
35351G 


40547B 
47645A 
62603D 
62115C 
67653D 
65301A 
73757D 
41403B 
56733A 
62125A 
70535C 
46047B 
76175C 
41163A 
72051C 
57521A 
47043B 
46605A 
44307B 
63117D 
75363D 
75303F 
60253F 
67401G 
41177F 
53233€ 
44367B 
43775A 
41433B 
734578 
77001C 
66545G 
47551E 
67201G 
61267H 
54627E 
60025E 
53657F 
54737F 
44073F 
63513H 
53061E 
75521E 
41171A 
47615A 
64157D 
55165E 
71301G 
53361A 
55771A 
62467H 
45773F 
44023F 
65575E 
506678 
70215C 
456176 
729076 


845 
869 
1ITS 
1205 
1325 
1365 


if 

29 

41 

53 

65 

77 

89 
101 
113 
ie 
VST 
149 
161 
1 
185 
197 
209 
221 
233 
245 
265 
277 
289 
301 
313 
329 
341 
353 
365 
STE 
393 
405 
417 
429 
441 
457 
469 
481 
493 
537 
553 
565 
581 
593 
605 
621 
633 
653 
665 
681 
693 
709 
721 
733 
749 
785 
197 


34603H 
20571E 
337216 
30177H 
31231G 
26053F 


43333E 
62677G 
64457G 
SS753F 
S9ZSSE 
67517H 
45555E 
56625E 
53253F 
71073E 
46327F 
60645G 
65153H 
47667F 
64223H 
67173H 
65133H 
64377H 
73647H 
40363E 
70553F 
74315E 
45671E 
44203F 
656614 
67101G 
40665E 
65667E 
43173E 
SZSCTe 
45737E 
71323A 
TLS 
43723B 
40511A 
77703A 
60471G 
T5443F 
61175E 
45761E 
43377B 
46321E 
46701E 
41307F 
53057F 
5 7407F 
64215C 
56465A 
46215E 
71263G 
64003C 
640330 
72153G 
56435E 
553318 
764016 
52603F 
SLOOP 


851 
871 
1179 
1227 
1331 


19 
Ep | 
43 
$5 
67 
To 
91 
103 
VPS 
LF. 
13g 
15% 
163 
175 
187 
199 
eur 
223 
235 
247 
267 
2F9 
291 
303 
315 
331 
343 
355 
367 
379 
395 
407 
419 
431 
443 
459 
471 
483 
495 
539 
S35 
567 
583 
595 
611 
623 
635 
655 
667 
683 
695 
711 
723 
739 
751 
707 
603 


appendix C 


31047H 
30301G 
34775G 
26347F 
311316 


51761E 
44103F 
57231E 
72427D 
41753F 
45653F 
74561G 
70311E 
66411E 
67333H 
717470 
40317F 
50351E 
41441E 
4233 7F 
50661E 
53543F 
73725G 
74427H 
75201G 
66675G 
66031A 
TipZse 
50343A 
42361A 
62251C 
63331G 
61677H 
46305E 
52621E 
64035G 
62767G 
40353F 
61251E 
71721G 
65057H 
53513B 
67267D 
65031A 
63463C 
45641E 
51431A 
53763B 
70425E 
55103F 
64653F 
76377H 
51745A 
50613E 
41315E 
71645G 
45533E 
60117D 
67157C 
5201 7F 
630434 
S7503F 
ST4TSE 


853 
873 
1189 
1229 
ovo 


2h 

33 

45 

ST 

69 

81 

93 
105 
117 
129 
141 
153 
165 
itt 
189 
201 
213 
223 
23¢ 
249 
269 
281 
293 
305 
317 
336 
345 
357 
369 
381 
397 
409 
421 
433 
445 
461 
473 
485 
529 
541 
S57 
569 
585 
597 
613 
625 
645 
657 
669 
685 
697 
713 
725 
74) 
754 
7A9 
805 


37305G 
34757H 
23571 
27477F 
25503F 


54055A 
46425A 
52737B 
64715A 
74247D 
72501C 
60523B 
75547C 
57745A 
70677C 
00203 

47727A 
42711A 
54175A 
51275A 
41735A 
62431A 
43611A 
53747A 
63155C 
55501A 
62505G 
61443E 
77747H 
43047F 
642516 
71545C€ 
53525A 
4566368 
400638 
52225A 
731374 
760556 
47357F 
651216 
762256 
67303 
533738 
517076 


65277F . 


63227" 
71147 
56464F 
741170 
544490 
65513" 
573656 
00217 

77211¢€ 
62225¢ 
762296 
50007F 
466170 
714086 
519178 
697690 
636670 
6195996 





irreducible polynomials 


DEGREE 14--CONTINUED 


807 
819 
839 
851 
867 
879 
903 
915 
931 
943 
955 
1107 
1123 
TRS9 
pI iy! 
1187 
1203 
1223 
1239 
1255 
1307 
1323 
1351 
1367 
1383 
1419 
1435 
1451 
1479 
1591 
1619 
1639 
1683 
1703 
tke 
1747 
2347 
2387 
2451 
2643 
2139. 
2867 


DEGREE 
o 
19 
29 
39 
49 
59 
69 
79 
89 
99 
109 
119 
129 
139 
149 
159 
169 
179 
189 
199 
209 


60561C 809 
TI6S5SC. S27 
54635E 841 
57033F 853 
74133D 869 
75605C 881 
00375 905 
41001A 917 
40655E 933 
62671E 945 
46773F 1093 
44523B 1109 
44147E 1125 
47637F 1141 
61621G 1173 
44343F 1189 
60241C 1205 
74531G 1225 
54321A 1241 
74357H 1257 
56061E 1309 
TLOSTO 1325 
72643H 1353 
65227H 1369 
52267B 1385 
00211 1421 
50325E 1437 
55111E 1453 
62745C 1481 
66405A 1593 
70633H 1621 
57327F 1641 
57743A 1685 
52071E 1705 
43731A 1721 
56345E 1749 
53727F 2349 
51213E 2389 
00357 2453 
56421A 2645 
44537B 2741 
47121E 5461 


15 
102067F 
110075E 
163005G 
117423F 
125263B 
147047F 
LOZITIE 
LISLSSE 
173117E 
1717376 
136173F 
177535C 
115135€ 
112273F 
140703F 
123023F 
1444736 
1647276 
19962768 
127149" 
1444610 


SSSTSE O11 
54003F 823 
46505E 843 
54077F 855 
72441G 871 
52467F 883 
63537H 907 
70773H 919 
44221A 935 


74277D 947 
72155G 1095 
54257F 1111 
SAT SLC V7 
40071E 1143 
PLSLIAUL TS 
SSTOSE TIAL 
65705E 1207 
74607H 1227 
75571G 1243 
70267D 1259 
66427G 1315 
TIL4HSF 613931 
41777B 1355 
SSOTSF 1371 
63153F “1387 
tS273F AZT 
70713C 1443 
40633F 1459 
41755E 1483 
60121C 1607 
65615G 1623 
66277D 1643 
42645E 1687 
61237H 1707 
S6TITE 2735 
44441A 1751 
65637C 2355 
70273H 2395 
76047H 2459 
76213H 2667 
76505G 2763 
00007 


a 
ll 
22 
31 
41 
51 
61 
71 
81 
91 

101 
111 
+ ol 
131 
141 
151 
161 
171 
16) 
191 
201 
a1) 


100003F 
104307F 
127701A 
103437A 
106341E 
126007E 
LILSTEE 
1704656 
123067F 
125747B 
152417F 
122231E 
102643F 
137067E 
145573F 
101961A 
LO37S1A 
1623756 
1029676 
1569990 
L761 998 
1914476 


62027H 813 
62347F 825 
64407C 845 
42567B 857 


43577F 873 
61757F 885 
52457E 909 
56031E 921 
55323F 937 


64617G 949 
56067A 1097 
63567H 1113 
41657F 1129 
47771A 1161 
r2OLe: LUN 
40413B 1193 
71117H 1209 
T1T63C 1Zz29 
77515G 1245 
46461E 1301 
54517F 1317 
SISSIC 1335 
71675G 1357 
MUP2TS: V3 
72337G 1389 
73555G 1429 
72513D 1445 
61641G 1461 
65727F 1485 
71615E 1609 
64605C 1625 
56007F 1645 
50045E 1689 
67533B 1709 
54041E 1737 
76663H 1753 
57143B 2357 
62101G 2405 
75723F 2469 
64213D 2709 
65375C 2765 


 e! 
23 
33 
43 
$3 
63 
73 
83 
93 
103 
113 
123 
133 
143 
153 
16% 
179 
164 
195 
203 
215 


102043F 
100317F 
102061E 
112611E 
161007H 
105257E 
127635A 
131427E 
102561E 
124677B 
1423056 
164705G 
103145E 
122707A 
114273F 
103125€ 
1594464H 
191019F 
1479609" 
1145050 
129075A 
1796618 


64633C 
63271C 
57017E 
50455E 
52353B 
66105C 
447354 
60227D 
T6005E 
S2U30F 
63007E 
43215A 
77235G 
00271 

70251G 
64641E 
66703D 
76707H 
57611A 
77345G 
72465C 
70201C 
63073H 
61363H 
56607A 
672256 
STIS TH 
65315C 
742630 
77615G 
55075E 
55703F 
74255C€ 
55417F 
44613A 
SOT TTR 
44741E 
50241E 
73145C 
00313 

50721E 


15 
25 
35 
45 
55 
65 
Th 
85 
95 
105 
115 
125 
135 
145 
155 
165 
175 
145 
195 
205 
a1 


815 67123F 
827 71337F 
847 54751E 
859 62533H 
875 55325E 
887 51261E 
911 62413H 
923 713456 
939 55435A 
951 56637B 
1099 47111E 1 
1115 736656 1 
1131 65643B 1 
1163 57541E 1 
1179 43633B 1 
1195 44567E 1 
U2 S347 
1235 60235G 1 
1251 55643B 1 
1303 51243F 1 
1319 -50733F 2 
L335) WiosLGat 
1363 47537E 1 
1379 43701E 1 
1395 40371A 1 
L4A3h “6627S a 
1447 61333G 1 
1463 43647F 1 
1587 41573B 1 
1611 41447B 1 
1627 731516 1 
MEST P7277 OY 
LES “S36 295 12 
L713 “45173 E 7 
1739 70341G 1 
1755 70443D 2 
2379 67627D 2 
2411 65263H 2 
2475 61377D 2 
2732 41235© i2 
2TTY WSS$1T7TR*2 


110013F 
EITTTSE 
114725E 
137733B 
174003E 
114467E 
114633E 
161615E 
170057H 
134531E 
146255C 
L77757F 
112751E 
1L74443E 
124511E 
1$0451¢ 
1775416 
11 7767A 
1929670 
1769616 
1799976 
191049" 


me 
27 
aT 
47 
ST 
67 
77 
87 
97 
107 
rT 
127 
137 
147 
157 
167 
177 
187 
197 
207 
viy 


25% 


817 43445A 
837 57715A 
849 42417A 
861 42411A 
877 67527G 
889 62723D 
913 51671E 
925 46125E 
941 42531E 
953 47753F 
101 540214 
117 45335E 
133 51055E 
165 57107F 
181 53315E 
197 46451A 
221 45355A 
237 47673F 
253 46175E 
305 76151 
321 74045G 
337 640216 
365 61261A 
381 65147H 
397 42721A 
433 74711E 
449 40327A 
465 67621G 
589 55631E 
613 46437F 
637 75033H 
677 00345 

701 50477B 
717 614616 
741 52065E 
341 55471E 
381 77177G 
413 41241A 
477 41357F 
733 67605 
861 653576 


125253B 
103451E 
103251E 
120265E 
LUS39TE 
177207G 
133663F 
136143A 
125235E 
125507F 
120043F 
146637E 
151537G 
100541E 
122563B 
147303G 
101561E 
160521G 
172431€ 
1522356 
1171496 
14729270 






































258 


DEGREE 
219 
229 
239 
249 
263 
273 
283 
293 
303 
313 
323 
333 
343 
353 
363 
373 
387 
397 
407 
417 
427 
437 
447 
457 
467 
477 
487 
497 
523 
533 
543 
553 
563 
573 
587 
597 
607 
617 
627 
637 
651 
661 
671 
681 
691 
701 
715 
725 
735 
745 
755 
777 
787 
797 
807 
817 
827 
841 
851 
861 
871 
881 
891 
909 
919 


15=-CONT INUED 


166775E 
156745G 
117633F 
116135E 
TETSLIE 
121125A 
112231E 
TPISS5E 
110427F 
1442756 
163767H 
136237F 
100261A 
165355E 
104447F 
141655G 
140733F 
150225G 
153327E 
176735E 
167051A 
122121E 
150167H 
IS3S7LE 
177707G 
112407F 
125613F 
135017B 
105555E 
176147H 
112245E 
156065C 
141151G 
L2Y3S5E 
124647E 
BS T253F 
165473F 
144115E 
165451G 
160553D 
166761C 
146727H 
113147F 
120661E 
1752416 
122603F 
112365E 
135401E 
142713C 
163617G 
1202478 
177065C 
113465E 
126001E 
176643H 
163723G 
152447H 
144377H 
106251E 
132037A 
160401G 
127723F 
157057H 
173105E 
130745E 


221 
232 
241 
251 
265 
27a 
285 
295 
305 
315 
325 
335 
345 
355 
365 
S75 
389 
399 
409 
419 
429 
439 
449 
459 
469 
479 
489 
499 
525 
535 
545 
$55 
565 
579 
589 
599 
609 
619 
629 
643 
653 
663 
673 
683 
693 
707 
TER 
727 
137 
747 
757 
779 
789 
T99 
809 
819 
829 
843 
853 
863 
873 
883 
901 
911 
921 


153143G 
170623B 
103605E 
102337E 
115141E 
136577F 
165033E 
177101G 
ESTATE 
ISTSL3Cc 
110717E 
132103F 
170227H 
150243H 
143301G 
160113G 
124243E 
134741A 
140573H 
115307F 
1771756 
162463G 
175465E 
135215E 
143501C 
165563E 
114713F 
126753F 
153425C 
114621E 
AZAZSLE 
156725G 
126015E 
166021G 
163761C 
151551G 
113057B 
156635G 
160305E 
123561E 
1535556 
132753F 
125323F 
154545G 
160237B 
170507C 
146111E 
102441E 
102615E 
175043E 
16444 7H 
117071E 
152263G 
170307F 
130303F 
116075A 
126205E 
100713E 
116277F 
147767G 
102057F 
120471E 
162153F 
102507F 
177817H 


223 
233 
243 
253 
267 
277 
287 
297 
307 
327 
Ser 
337 
347 
357 
367 
3TT 
391 
401 
411 
421 
431 
441 
451 
461 
471 
481 
491 
501 
527 
Sort 
547 
557 
567 
581 
591 
601 
611 
621 
631 
645 
655 
665 
675 
685 
695 
709 
i", 
729 
739 
749 
759 
781 
791 
801 
811 
821 
835 
845 
855 
865 
875 
885 
903 
913 
923 


172213F 
140373G 
116361E 
1735156 
173613F 
TLSZ2e 
1201778 
143703G 
110037F 
133775E 
175001E 
171035G 
101233F 
163353C 
165011G 
106715E 
116073E 
157111G 
113625E 
141635E 
146331G 
134037B 
LI3Z255E 
110221E 
161667F 
112053E 
165113G 
137765E 
115313A 
ISSTSIE 
141757G 
TUIS7IGE 
171335C 
145361C 
114457E 
113645E 
160173H 
150633H 
146025E 
116637F 
Is2I2rF 
143343A 
123235E 
133553F 
07 TSE 
160757G 
122003F 
175515G 
105713F 
132051A 
173667F 
115537E 
1776170 
174425E 
125471E 
150677G 
120557E 
121251E 
106611E 
164531G 
146133¢C 
162455G 
151755¢ 
176037H 
11492 7F 


225 
235 
245 
259 
269 
279 
289 
299 
309 
eee | 
329 
339 
349 
359 
369 
379 
393 
403 
413 
423 
433 
443 
453 
463 
473 
483 
493 
503 
529 
539 
549 
559 
569 
583 
593 
603 
613 
623 
633 
647 
657 
667 
677 
687 
697 
711 
721 
731 
741 
i | 
761 
783 
793 
803 
813 
823 
837 
847 
857 
867 
877 
887 
905 
915 
925 


appendix C 


105213E 
152361G 
137523A 
136321A 
19T735E 
1145338 
117547F 
106047E 
160511G 
134447E 
100377A 
132651E 
100445E 
114041E 
137361E 
140575E 
147321E 
134411A 
101673B 
157241G 
166541G 
174571E 
137325A 
157435E 
157427G 
135363B 
143733G 
106577E 
105761E 
152763C 
160547F 
137643F 
146717H 
134325E 
155243G 
150305G 
177663F 
115061A 
106751E 
111423E 
112333E 
131705E 
103653F 
132001E 
172415E 
171207G 
121273B 
132507E 
134241E 
104217F 
137051E 
135201E 
104755E 
112475E 
1737116 
175227G 
160335A 
1411230 
174563H 
155065E 
117021E 
130627F 
170277H 
1716276 
127167F 


227 
237 
247 
261 
271 
281 
237 
301 
SUE 
321 
S37 
341 
337 
361 
371 
381 
395 
405 
415 
425 
435 
445 
455 
465 
475 
485 
495 
521 
531 
541 
551 
561 
Diy 
585 
595 
605 
615 
625 
635 
649 
659 
669 
679 
689 
699 
713 
23 
T33 
743 
753 
iti 
785 
Tes 
805 
815 
825 
839 
849 
859 
869 
879 
889 
907 
917 
927 


156053H 
142157H 
101705E 
120447F 
114225E 
166151E 
126051E 
1374278 
1537316 
127347E 
125121E 
134105A 
144707G 
113025E 
117201A 
1121236 
12372te 
1723176 
170543F 
153005E 
102513F 
123433F 
123045A 
121437A 
150671G 
130617F 
162155E 
VI2Uiae 
132165E 
124757F 
101331E 
156237G 
130305E 
157155E 
1531370 
1637456 
161117H 
143253H 
132625E 
117107E 
135267F 
141005E 
173025C 
153773G 
145111G 
1475538 
122005E 
130223F 
173643F 
115523F 
104073B 
146643F 
1474156 
173263C€ 
165547E 
166407H 
125543E 
174517F 
140023H 
146263F 
147003F 
152135¢ 
165633 
162171€ 
1991198 





irreducible polynomials 


DEGREE 
929 
939 
949 
963 
973 
983 

1057 
1067 
1077 
1091 
1101 
BE Gi) 
1125 
1135 
1145 
1163 
1373 
1187 
1197 
1207 
1221 
1231 
1241 
1255 
1265 
1295 
1305 
1349 
1329 
1339 
1393 
1363 
1373 
1387 
1397 
1419 
1429 
1443 
1453 
1463 
1477 
1487 
1497 
bh ib | 
1573 
1583 
1593 
1611 
1621 
1635 
1645 
1655 
1677 
1687 
1701 
1711 
1721 
1739 
1749 
1763 
1773 
1811 
1621 
16395 
1645 


15=--CONTINUED 


160461E 
166737F 
1626456 
134755E 
104163A 
133041E 
000057 

144713F 
177621G 
161235G 
101507E 
171125E 
133011€ 
103663E 
105413F 
176657H 
165565G 
171467H 
167765C 
LS625TF 
127071E 
134567F 
110103E 
155445E 
127457F 
135151A 
111641E 
150231G 
165303G 
105415E 
154023H 
144225G 
101515E 
121143E 
127401E 
117715E 
115045E 
176741E 
170051G 
164121A 
140557A 
111033F 
105725E 
166267E 
176111G 
124341E 
152345G 
146203E 
140747F 
L17IS1€ 
133407A 
136335E 
157557E 
144653C 
146543¢C 
17601436 
1441516 
112223F 
1760156 
150327F 
1707636 
1691250 
1042658 
1a407T1e 
10669%r 


931 
941 
951 
965 
975 
985 
1059 
1069 
1079 
1093 
1103 
1113 
1127 
1137 
1147 
1165 
L275: 
1189 
1199 
1209 
1223 
1233 
1243 
1257 
1267 
1297 
1307 
1920 
1331 
1341 
1355 
1365 
1379 
1389 
1399 
1421 
1431 
1445 
1455 
1465 
1479 
1489 
1499 
1561 
1575 
1585 
1595 
1613 
1623 
1637 
1647 
1657 
1679 
1689 
1703 
1713 
1723 
1741 
1751 
1765 
1775 
1615 
1H27 
1697 
hay 


117137B 
147571G 
162403G 
116645E 
167753F 
156767H 
104427F 
121605E 
110741E 
144137G 
145271E 
147071A 
162337A 
146043H 
143651C 
1664256 
DM21S3F 
150161E 
103415E 
175177B 
142457F 
156321G 
127161E 
140441E 
102205A 
106641E 
134403E 
175651G 
116675E 
122445E 
127225E 
115205A 
1260238 
L12RS577E 
150317E 
162657B 
177115G 
141475G 
147707F 
111003F 
156655G 
172123G 
1BeTSSE 
153461C 
137331A 
127215E 
164441G 
120417F 
107037F 
105173F 
136215E 
167255E 
1O7711E 
176203H 
130033F 
1477516 
110433F 
1116435E€ 
1424616 
126325€ 
1241 75€ 
1510970 
154 769A 
164247 
1954n7e 


933 

943 

953 

967 

977 

987 
1061 
1071 
1081 
1095 
1105 
1115 
1129 
1139 
1157 
1167 
1177 
1191 
1201 
1211 
1225 
1235 
1245 
1259 
1269 
1299 
1309 
1323 
1333 
1347 
1357 
1367 
1381 
1391 
1401 
1423 
1433 
1447 
1457 
1467 
1481 
1491 
1501 
1563 
1577 
1587 
1605 
1615 
1625 
1639 
1649 
1671 
1681 
1691 
1705 
1715 
17433 
1743 
1753 
1767 
hicks 
1415 
1029 
1499 


jn4a9 


134323F 
127743F 
105335E 
143307G 
127423F 
116037A 
113075E 
122225A 
136745E 
140675E 
151735E 
134721E 
105261E 
151403H 
1561578 
103617E 
111243E 
12207 TE 
137703E 
1413178 
122021A 
114335E 
163273H 
103761E 
112251E 
102265E 
102667A 
160377B 
140221A 
143631E 
176427H 
123307E 
166553H 
132747E 
177731G 
171745G 
155751G 
112553E 
160445A 
167331E 
164561G 
146667D 
150261G 
166011G 
1654076 
135005E 
172621G 
103553F 
135503E 
105071E 
153113H 
1463016 
174751E 
155213H 
166311A 
1315438 
L71173F 
197165C 
1542939€ 
126105A 
17649976 
1214910 
1927090 
166119" 
174699" 


955 

945 

955 

969 

979 

989 
1063 
1073 
1083 
1097 
1107 
1117 
1131 
1141 
1159 
1169 
Tro 
1193 
1203 
1213 
1227 
1237 
1251 
1261 
1291 
1301 
1315 
1325 
1335 
1349 
1359 
1369 
1383 
1393 
1415 
1425 
1435 
1449 
1459 
1469 
1483 
1493 
1507 
1565 
1579 
1589 
1607 
1617 
1627 
1641 
1651 
1673 
1683 
1693 
1707 
ie 
1735 
1745 
1755 
1769 
1407 
1417 
165) 
1A4) 
105) 


123361E 
116351A 
124767E 
124125E 
115667F 
142267G 
162133H 
134657E 
1925316 
145277G 
157205G 
122123F 
101427E 
100157A 
102463F 
160021A 
165655G 
125403F 
111563F 
177467H 
146771E 
111603E 
144533F 
173523F 
106311E 
1644536 
LITOSSE 
136063E 
100201E 
137441E 
151265C 
133437E 
172701E 
143057C 
155335G 
130527F 
103767A 
154307D 
161031E 
165311G 
114231E 
1435236 
122517E 
133445E 
106445E 
117731A 
143567G 
110567A 
126735E 
174167G 
141321E 
131265A 
133257F 
135207F 
150213G 
VLLTILE 
116367F 
135223F 
114677F 
111719" 
1646676 
1101656 
16995956 
101625A 
161657" 


937 
947 
957 
Lek 
981 
991 
1065 
1075 
1085 
1099 
1109 
2122 
1138 
1143 
1161 
LAL 
1181 
1195 
1205 
1219 
1229 
1239 
1253 
1263 
1293 
1303 
LL 
1327 
1337 
1351 
1361 
1371 
1385 
1395 
1417 
1427 
1437 
1451 
1461 
1475 
1485 
1495 
1509 
1571 
1581 
1591 
1609 
1619 
1629 
1643 
1653 
1675 
1685 
1699 
1709 
1719 
1737 
1747 
1757 
ae! 
1809 
1619 
1499 
104% 
186) 


259 


105237F 
197325€ 
VFSB01E 
155261G 
140171E 
130635E 
120717F 
130125E 
115455A 
114303B 
114011E 
104735E 
156563F 
163653E 
151025G 
161277H 
134165E 
170007H 
147305G 
140421G 
110211E 
121275A 
LP3yss¢ 
167307F 
141633F 
163071G 
115373F 
101073F 
103223B 
104421A 
150215E 
166653E 
140271G 
WL TB 
123057F 
144467G 
115127E 
105621E 
131405E 
157405G 
106407F 
170765G 
107567E 
156365G 
145551C 
110141E 
153443H 
126067F 
172445G 
114745A 
132523F 
LZOL33F 
151217G 
131367F 
143227F 
111267F 
115421E 
106143F 
103363A 
1723038 
196611E 
1720086 
199071€ 
14842 7H 
1746056 














260 


DEGREE 
1863 
1873 
1883 
1897 
1907 
2189 
2203 
2217 
2231 
2249 
2263 
2207 
2323 
2333 
2347 
2361 
2379 
2393 
2407 
2421 
2455 
2469 
2483 
2501 
2515 
2605 
2631 
2645 
2659 
2669 
2707 
tht 
2731 
2745 
2771 
2781 
2839 
2853 
2867 
2889 
2903 
20n7 
2931 
2969 
3175 
3213 
3227 
3245 
3271 
3285 
3355 
3373 
3399 
3413 
3431 
3477 
3495 
3509 
4683 
4709 
4763 
4789 
4907 
4941 
5291 


15=--CONT INUED 


136701E 
142737H 
106457B 
141677C 
LA7As Fr 
161205G 
113061E 
133641E 
130737F 
TATO2 TE: 
145727D 
LPTASTG 
123163F 
13235 7F 
137601E 
157711G 
116057F 
Np rahen gods 
155175G 
151747G 
106745E 
150005G 
126227F 
101433F 
172363H 
147725G 
142611G 
112347F 
143531E 
111047F 
165201G 
LUSLALE 
165535G 
153175G 
12743 7F 
170501G 
134255E 
110573E 
154537F 
160137E 
141125G 
154331G 
13645 7F 
146753E 
127365E 
131651A 
102357B 
1422236 
177377G 
144437G 
165725E 
1332 13E 
127077E 
116601E 
162037H 
1LOFS73E 
110501E 
121617F 
133261A 
155303H 
141115G 
123471E 
124621A 
1607234 
155707 


1865 
1875 
1885 
1899 
1909 
2195 
2205 
2219 
2233 
2251 
2265 
2279 
2325 
2339 
2349 
2363 
2381 
2395 
2409 
2443 
2457 
2471 
2485 
2503 
2517 
2611 
2633 
2647 
2661 
2675 
2709 
2723 
2733 
2759 
2773 
2787 
2841 
2855 
2869 
2891 
2905 
2989 
2957 
2971 
3177 
3229 
3237 
3251 

3273 
3287 
3365 
3379 
3401 

3415 
3433 
3479 
3497 
3511 

4685 
4715 
4773 
4811 

4909 
494T 
§294 


144425E 
1SZ2301€ 
152253H 
102733E 
10034 7F 
101313E 
170211¢€ 
160175C 
166137C 
106273F 
121451A 
112633E 
100725A 
141231E 
143271G 
170337E 
156773H 
106713F 
170367G 
173153B 
165327B 
146007A 
173163B 
155757H 
120463E 
1775270 
110435E 
L26255E 
141445E 
107121E 
1067678 
133533A 
114701E 
155407A 
176255E 
126711E 
10373 7F 
LISLE 
114347B 
163647B 
107337A 
115607A 
126433F 
132741E 
107645E 
170523H 
163365G 
164155G 
100647E 
177443H 
110405E 
155621C 
136213E 
147437H 
141027E 
125337A 
104111E 
103333F 
123735E 
160215G 
161105E 
137613F 
122443E 
1316018 
194P77F 


1867 
1877 
1891 
1901 
19% 
2197 
2211 
2221 
2235 
2253 
2267 
2281 
2327 
2341 
2355 
2373 
2387 
2397 
2411 
2445 
2459 
2473 
2487 
2505 
2519 
2613 
2635 
2649 
2663 
2677 
2711 
2725 
2739 
2761 
2775 
2789 
2843 
2857 
2871 
2893 
2907 
2921 
2963 
2973 
3179 
3221 
3239 
3253 
3275 
3289 
3367 
3381 
3403 
3417 
3435 
3481 
3499 
3519 
4691 
4717 
4779 
4813 
4915 
4949 
9299 


126747F 
131727E 
157645A 
135443F 
130415A 
175203F 
102763E 
161061E 
13001 7F 
TOTZUTE 
146607F 
137545E 
162315G 
117457F 
143727F 
166257D 
114371A 
LIT7516 
LBZOP5E 
111505E 
153577H 
146155E 
103175E 
121017F 
154561G 
121641E 
104575A 
131667F 
104141E 
106125E 
152351G 
175405G 
146177H 
14543 3H 
134435E 
103257E 
164001G 
116631E 
140755G 
121725E 
LTTL25E 
154411E 
154515E 
145477H 
117443F 
167313H 
172027H 
176753H 
121101E 
101613F 
107675A 
114363A 
UIADISE 
100223E 
125255E 
110255E 
146375G 
103053E 
142175G 
163275G 
100021E 
105701E 
123537E 
119405A 
14051 4¢ 


1869 
1879 
1893 
1903 
2185 
2199 
2243 
2227 
2245 
2259 
2269 
2283 
2329 
2343 
2357 
2375 
2389 
2403 
2413 
2451 
2461 
2475 
2489 
2507 
2601 
2615 
2637 
2651 
2665 
2699 
2713 
2727 
2741 
2763 
2777 
2792 
2845 
2859 
2873 
2899 
2909 
2923 
2965 
3171 
3181 
3223 
3241 
3255 
3277 
3291 
3369 
3383 
3405 
3419 
3437 
3483 
3501 
3527 
4693 
4755 
4781 
4819 
4917 
4955 
§901 


appendix C 


157441C 
120221E 
141541G 
124251E 
147161G 
154507G 
167367H 
103035E 
122213F 
146373F 
113543F 
140227F 
155027G 
143403H 
107447F 
131733€ 
155505G 
175601G 
126375E 
127243F 
150341G 
117655E 
105143F 
100425E 
126771E 
111365E 
164313G 
141365G 
167001G 
167203G 
144731G 
177231G 
121327E 
167463H 
124335E 
120601E 
161147F 
131623E 
LEZ5.15E 
157255G 
144603H 
154155E 
150371G 
000073 

163335E 
137127F 
131165A 
152433B 
142751E 
142633H 
115133E 
161253F 
121553E 
126643E 
166275A 
114611E 
126557F 
171371E 
131645E 
124053F 
1165678 
121305€ 
124317F 
1959176 
1LIO41A 


1871 
1881 
1895 
1905 
2187 
2201 
2215 
e229 
2247 
2261 
2275 
2285 
2391 
2345 
2359 
2377 
2391 
2405 
2419 
2453 
2467 
2477 
249] 
2509 
2603 
2617 
2643 
2653 
2667 
2701 
2715 
2729 
2743 
2765 
2779 
2493 
2851 
2861 
2887 
2901 
2915 
2925 
2967 
31738 
3187 
3228 
3243 
3257 
3283 
3301 
3371 
3385 
3411 
3429 
3475 
3493 
3507 
4681 
4699 
4757 
4787 
4621 
4939 
9265 
5323 


167015E 
102147E 
TOSS SIE 
150731G 
154247F 
121055A 
106503F 
173037F 
1445770 
153445C 
161013A 
112377 
173551¢ 
124005A 
136401A 
176453 
100641E 
177563G 
170433F 
107323F 
155737H 
101023E 
174743G 
126657E 
156161E 
125057E 
126163E 
116307B 
110343A 
175337F 
161043G 
127653E 
132277F 
104263A 
143373D 
155773B 
135565E 
1557256 
120155E 
1414016 
147635E 
122275E 
1733316 
124115E 
115675E 
140205E 
162241E 
125271€ 
115721A 
156527H 
1015578 
160413F 
1400076 
1332318 
1716216 
114055A 
125361A 
000013 

1676376 
1332016 
1456756 
1467056 
1066776 
000045 

127273F 





irreducible polynomials 


DEGREE 
5325 
5427 
5461 


DEGREE 
9 

19 

29 

39 


15==-CONT INUED 


117243F 
170037E 
145453E 


16 
225657B 
307527H 
201735E 
327721¢€ 
305667H 
271055E 
323527D 
233503F 
244461E 
351641C 
273435E 
327277D 
357047D 
367737H 
217137F 
304731C 
260237F 
352603H 
243513B 
201551E 
256317E 
254601A 
322661G 
230653F 
330561C 
255S17F 
366421G 
243111A 
323341C 
335227H 
233017B 
213651E 
274627F 
223133B 
276531E 
274353F 
254471A 
241341E 
370137H 
303375C 
211101E 
220625E 
206635A 
217473F 
302321G 
325033D 
342325G 
237351E 
273141A 
273015E 
202703F 
2576438 
2050038 
236511€ 
3626334 
292211A 
2711618 
341147 
2051498 
s96907TH 


5331 
5429 


11 

21 

31 

41 

St 

61 

4 

81 

91 
101 
rT 
121 
131 
141 
151 
161 
171 
181 
191 
201 
211 
221 
231 
241 
2or 
261 
271 
281 
291 
301 
Sit 
327: 
a3% 
341 
351 
361 
371 
381 
391 
401 
411 
421 
431 
441 
451 
461 
471 
481 
491 
501 
519 
529 
539 
549 
559 
569 
579 
SAO 
999 
609 


141707H 
107127E 


210013F 
233303F 
363501C 
272201E 
270155E 
237403B 
313371G 
346355G 
261105A 
204015E 
376311G 
202545A 
250723F 
214443 F 
230535A 
262367F 
303657H 
311651C 
310017H 
312301G 
362558C 
333117H 
212063B 
274635A 
342105G 
211473F 
344733D 
221257F 
242225E 
271725A 
2I3S75E 
266701E 
200365A 
302335G 
356255G 
325413D 
222563F 
356221G 
335263D 
300405C 
257051E 
324755C 
332745G 
320731G 
3663730 
333323H 
341667H 
202265A 
3417416 
233743F 
267421A 
241245A 
267507F 
3661556 
2TTTOSA 
2010316 
3413456 
3279670 
S7142a7TH 
2129868 
2611770 


5333 
5451 


13 

23 

33 

43 

53 

63 

73 

83 

93 
103 
113 
123 
133 
143 
153 
163 
173 
183 
193 
203 
213 
223 
233 
243 
253 
263 
273 
283 
293 
303 
313 
323 
333 
343 
353 
363 
373 
383 
393 
403 
413 
423 
433 
443 
453 
463 
473 
483 
493 
503 
521 
541 
541 
55} 
561 
§7) 
601 
49) 
601 
61) 


134205E 
161465E 


215435A 
307107H 
306357H 
310327D 
302157H 
236107F 
333575C 
350513H 
306221G 
327421C 
201637F 
243575E 
340047D 
277213F 
342567H 
3016630 
212653F 
256005E 
333013D 
260475E 
333643H 
274317B 
207661E 
326035G 
305471C 
266663F 
311155G 
2077538 
204703F 
353263H 
340333D 
262351E 
215613B 
251211A 
337553H 
362737H 
2317538 
235275E 
311515G 
227157B 
245367F 
326261G 
374163D 
243631E 
230355E 
344045C 
276645E 
247617F 
361353D 
252023B 
351353H 
356057H 
311661¢C 
212115€ 
241251€ 
3716440 
5747216 
S792149H 
POO4SI1A 
esperar 
s17709H" 


5419 
5453 


abe 

25 

Be, 

45 

| 

65 

75 

85 

95 
105 
£15 
125 
10 
145 
PSS 
165 
PhS 
185 
195 
205 
205: 
eeu 
235 
245 
255 
265 
2758 
285 
229 
305 
S15. 
325 
335 
345 
355 
365 
STS 
S35 
395 
405 
415 
425 
435 
445 
455 
465 
475 
485 
495 
505 
523 
533 
544 
553 
$64 
573 
9H5 
994 
604 
614 


107417F 
171027C 


227215A 
311513D 
353573D 
304341C 
374111C 
2121138 
267313B 
237421A 
267075A 
226455A 
365705C 
251645A 
274761A 
315633D 
265157B 
370565C 
245351A 
206353B 
256415A 
347211C 
304261C 
301425C 
317171C 
200215A 
242437B 
361617D 
340207D 
226315A 
323563D 
306575C 
2320138 
324141C 
207221A 
262421A 
215015A 
240171A 
227065A 
372075C 
202155A 
237733B 
324631C 
236555A 
264255A 
3257570 
301653D 
317163D 
346725C 
325475C 
260665A 
272423B 
377 TAC 
217633F 
235145E 
3754370 
211571€E 
3403116 
9107458C 
§30079H 
eor7T4aie 
5916270 
N618416 


5421 
5459 


ty, 

27 

37 

47 

57 

67 

77 

87 

97 
107 
117 
127 
137 
147 
157 
167 
177 
187 
197 
207 
2a 
227 
237 
247 
257 
267 
a7 7 
287 
297 
307 
317 
327 
337 
347 
357 
367 
377 
387 
397 
407 
417 
427 
437 
447 
457 
467 
477 
487 
497 
507 
525 
535 
545 
555 
565 
575 
585 
594 
605 
614 


261 


122401E 
174707H 


234313F 
336523D 
357333D 
242413F 
210205E 
314061C 
311405G 
203213F 
235063B 
202301E 
352125G 
277535A 
226135E 
3002056 
STATFLC 
201045E 
347433H 
362053D 
2 T6DTS< 
215345E 
230541A 
247353F 
214215E 
3241270 
363637H 
000717 

raion y pba) 
250017F 
230451E 
271251A 
312405G 
365221G 
323077D 
360667H 
221213F 
2411738 
217451E 
357527H 
254241A 
207717F 
274621E 
341343D 
234015E 
241677F 
264433B 
265401E 
3015356 
343213D 
276727F 
265617F 
3173570 
277215A 
202411A 
3543770 
2457338 
200751A 
227063B 
2730078 
9452670 
POILTBA 
sagri1ic 












































262 


DEGREE 
617 
627 
637 
651 
661 
671 
681 
691 
701 
pip 
721 
734 
741 
751 
761 
775 
785 
795 
805 
815 
825 
835 
845 
855 
865 
875 
885 
899 
909 
919 
929 
939 
949 
959 
969 
979 
989 
999 
1041 
1051 
1061 
1071 
1081 
1095 
1105 
PUES: 
bP25 
1135 
1145 
1459 
1169 
1179 
1189 
1199 
1209 
+223 
1233 
1243 
1253 
1263 
1273 
L291 
1301 
1311 
1321 


16--CONTINUED 


366345G 
2224738 
262073F 
221245A 
363271G 
224611E 
214143B 
306643H 
244333F 
202141A 
323175G 
2312536 
316757D 
344623H 
303361G 
256553B 
2017178 
272445A 
302635C 
275357B 
301347D 
2013678 
316261C 
2222678 
356471C 
350277D 
337063D 
315737H 
260775A 
244251E 
234545E 
356233D 
256653F 
332663H 
213625A 
226073F 
301451G 
214267B 
343055C 
3436556 
320445G 
2652314 
300155G 
325731C 
2445478 
310517D 
302167D 
317567D 
2113778 
272175E 
315713H 
337517D 

200535E 

364201G 
262615A 

301407H 
2143178 

214663F 
376415G 

256401A 

361521G 

276441E 

217041E 

240323B 

264037F 


619 
629 
643 
653 
663 
673 
683 
693 
703 
713 
723 
733 
743 
753 
763 
Ree 
787 
797 
807 
817 
827 
837 
847 
857 
867 
877 
887 
901 
911 
921 
931 
941 
951 
961 
971 
981 
991 
1001 
1043 
1053 
1063 
1073 
1083 
1097 
1107 
ERE. 
1127 
1137 
1147 
1161 
1171 
1181 
1191 
1201 
1211 
tees 
1235 
1245 
1255 
1265 
1275 
1293 
1303 
1313 
1323 


337521G 
233725A 
206603F 
324747H 
253723B 
267615E 
272071E 
366537D 
311733H 
256461E 
2360414 
330233H 
302115G 
211125A 
313751G 
223463B 
23025 7F 
325723H 
372301C 
301101G 
201607F 
222003B 
245265E 
335105G 
223255A 
240315E 
Z28733F 
3007330 
204343F 
311165C 
261141E 
256243F 
310671C 
367231G 
320225G 
201153B 
262233F 
2ECZS TE 
344651G 
201515A 
222425E 
365405G 
3337770 
376443H 
2126478 
312247H 
3372456 
255355A 
243135E 
222541A 
337503H 
353 7.33H 
2612638 
240411E 
360141G 
251705A 
370541C 
313407D 
213325A 
272627B 
3337330 
273253B 
222237F 
260655E 
370611¢ 


621 
631 
645 
655 
665 
675 
685 
695 
705 
715 
725 
735 
745 
755 
765 
7179 
789 
799 
809 
819 
829 
839 
849 
859 
869 
879 
889 
903 
913 
923 
933 
943 
953 
963 
973 
983 
993 
1003 
1045 
1055 
1065 
1075 
1085 
1099 
1109 
ET? 
1129 
1139 
1149 
1163 
E273 
1183 
1193 
1203 
1213 
1227 
1237 
1247 
1257 
1267 
1285 
1295 
1305 
1315 
1325 


362745C 
346101G 
317531¢ 
301065C 
260145A 
377373D 
364225C 
233521A 
2221238 
374343D 
260725A 
2104478 
322031C 
3370170 
366557D 
302577H 
357617D 
311103D 
24661 3F 
262135A 
202607F 
22372 LE 
2264478 
227475E 
301213H 
220343B 
221101E 
270403B 
Z225051E 
201771E 
374765C 
37305 3H 
27475 7F 
233035A 
323547H 
373363H 
373553D 
257507B 
211245A 
370743D 
2430438 
305301C 
3417030 
332033H 
322171G 
365307D 
247743F 
353153D 
3771470 
226367F 
326065C 
372435G 
273073F 
2741678 
315571G 
215615A 
313437H 
21632 3F 
SSS (71C 
216777F 
000433 

3410370 
2241076 
266671A 
5006430 


623 
633 
647 
657 
667 
677 
687 
697 
707 
717 
727 
737 
747 
THT 
tat 
781 
Tor 
801 
811 
821 
831 
841 
851 
861 
871 
881 
891 
905 
915 
925 
935 
945 
955 
965 
Exe) 
985 
995 
1005 
1047 
1057 
1067 
1077 
1091 
1101 
LEE 
1121 
1131 
1141 
1155 
1165 
PEGS 
1185 
1195 
1205 
L219 
1229 
1239 
1249 
1259 
1269 
1287 
1297 
1307 
1317 
1327 


appendix C 


366171G 
2612538 
215343F 
223561A 
337071G 
316431G 
230371A 
325173D 
234777F 
341061C 
222017F 
324073H 
226255A 
302063H 
000573 

234667F 
367333H 
310267D 
264507F 
350403H 
212737B 
200475E 
234155E 
3625770 
321453H 
343503H 
3435470 
271347B 
332655C 
305263D 
335205C 
204025A 
247275A 
355155¢ 
276031A 
3521230 
270253B 
365501C 
306573D 
313415G 
214371E 
364355C 
370275G 
2661678 
206257F 
310437H 
275141A 
222633F 
2532078 
324433D 
207307B 
3339515¢ 
2644638 
362715C 
303045G 
316505G 
275651A 
271655E 
306235G 
313627D 
2646378 
326715G 
202277F 
2TITOSA 
3996756 


625 
635 
649 
659 
669 
679 
689 
699 
709 
T19 
729 
739 
749 
759 
773 
783 
793 
803 
813 
823 
833 
843 
853 
863 
873 
883 
893 
907 
917 
927 
937 
947 
957 
967 
977 
987 
oT 
1007 
1049 
1059 
1069 
1079 
1093 
1103 
1125 
1123 
1133 
1143 
1157 
1167 
1177 
1187 
1197 
1207 
1221 
1231 
1241 
1251 
1261 
1271 
1289 
1299 
1309 
1319 
1329 


2042278 
354723D 
311203H 
232643F 
273361A 
237337 
240675E 
241647B 
304535G 
375761G 
352077D 
306015G 
351225G 
3752230 
326137H 
225405A 
346243H 
330177H 
341043D 
367033H 
232315A 
221151A 
305235G 
224671E 
341645C 
366673H 
231265E 
356741G 
276241E 
337547D 
303463H 
346467H 
277047B 
352653H 
213253F 
367065C 
263737F 
205535E 
264001E 
3077130 
370321G 
312615G 
267205E 
326461G 
277641A 
344513H 
216607F 
2545438 
337311G 
3606230 
232045E 
213523F 
3474630 
253603B 
362161C 
373237H 
361701C 
2656638 
214157F 
206173F 
32631 7M 
2160078 
2560638 
3777556 
3500570 





irreducible polynomials 


DEGREE 
1331 
1341 
1355 
1365 
1375 
1385 
1395 
1405 
1419 
1429 
1439 
1449 
1459 
1469 
1483 
1493 
1503 
1513 
1523 
1557 
1567 
1577 
1587 
1597 
1611 
1621 
1631 
1641 
1651 
1669 
1679 
1689 
1699 
1709 
1719 
1733 
1743 
1753 
1763 
1773 
1783 
1805 
1815 
1825 
1835 
1845 
1859 
1869 
1879 
1889 
1899 
1909 
1927 
1937 
1947 
1957 
1967 
1977 
2119 
2129 
2139 
2153 
2163 
2181 
2191 


16--CONT INUED 


353531G 
314651C 
277341A 
375517D 
371227D 
247027B 
242115A 
204351A 
2275778 
377405G 
243375E 
353045C 
331577H 
25552 7F 
355403H 
374471G 
376451C 
374277D 
255505E 
246455A 
277053F 
275247F 
371051C 
316145G 
210233B 
366057H 
364445G 
317373D 
354047H 
267221E 
236423F 
2727138 
216477F 
231361E 
360721C 
272267F 
32251 5C 
277145E 
261455E 
2078578 
201155E 
271563B 
262253B 
375333D 
3411170 
321507D 
341337H 
344203D 
344153H 
322111G 
333061C 
273235E 
331333H 
335717H 
3776230 
3000256 
277707F 
3055670 
2347116 
241757F 
251271A 
3965616 
2147798 
92591570 
S11427H 


1333 
1347 
1357 
1367 
1377 
1387 
1397 
1411 
1421 
1431 
1441 
1451 
1461 
1475 
1485 
1495 
1505 
1575 
1549 
1559 
1569 
1579 
1589 
1603 
1613 
1623 
1633 
1643 
1653 
1671 
1681 
1691 
1701 
1711 
1721 
1735. 
1745 
1755 
1765 
1775 
1785 
1807 
1817 
1827 
1837 
1847 
1861 
1871 
1881 
1891 
1901 
LPL 
1929 
1939 
1949 
1959 
1969 
1979 
2121 
2131 
2141 
2155 
2165 
21649 
7199 


303367H 
372705C 
252657F 
334347H 
225551A 
230365E 
220217F 
263047B 
331353H 
205335A 
303013H 
3531356 
327471C 
256311A 
315407D 
2076754 
237271A 
374573D 
241317F 
277565E 
254651A 
202753F 
254551E 
272207F 
277663F 
243217B 
370145G 
334555G 
2417678 
307541C 
3252756 
3173616 
3113370 
254323F 
217671E 
263401A 
213165A 
332415C 
S225 25C 
2013738 
214461A 
242305E 
227647F 
313647D 
Z2aetSLE 
347111G 
312471G 
202463F 
330235C 
314507H 
327337H 
371625C 
273703B 
2ULIZ3F 
234675E 
216455A 
201435E 
3557356 
3617070 
326423H 
S46179H 
222715A 
27T1P1SA 
3246616 
ss17oi1¢ 


1335 
1349 
1359 
1369 
1379 
1389 
1399 
1413 
1423 
1433 
1443 
1453 
1463 
1477 
1487 
1497 
1507 
Dol 
1551 
1561 
LSTA 
1581 
1591 
1605 
1615 
1625 
1635 
1645 
1655 
1673 
1683 
1693 
1703 
1713 
1723 
1737 
1747 
1757 
1767 
pei f 
1799 
1809 
1819 
1829 
1839 
1849 
1863 
1873 
1883 
1893 
1903 
1913 
1931 
1941 
1951 
1961 
1971 
1981 
2123 
2133 
2147 
2157 
e167 
7166 
7105 


‘ 


3327516 
346047H 
226075A 
225575E 
3431456 
321165C 
361563H 
261551A 
200677F 
213631E 
255655A 
215007F 
245313F 
333755G 
262471E 
330343D 
265553F 
250737F 
277347B 
367743H 
213075E 
256517B 
302257H 
2533178 
335645C 
337225C 
216177B 
255751A 
351157D 
334533H 
372057D 
347361G 
220741E 
302505C€ 
301021G 
215545A 
244425E 
360545G 
346335C 
210733F 
000703 

225735A 
3525770 
226117F 
344435C 
355323H 
307521C 
262645E 
247511E 
251765A 
225523F 
274571E 
270557F 
207163B 
200627F 
215411E 
333265C 
240477F 
213067F 
2539125A 
211905€ 
519226¢ 
Poorer 
2152998 
sasosic 


1337 
1351 
1361 
1371 
1381 
1391 
1401 
1415 
1425 
1435 
1445 
1455 
1465 
1479 
1489 
1499 
1509 
1519 
1553 
1563 
1573 
1583 
1593 
1607 
1617 
1627 
1637 
1647 
1657 
1675 
1685 
1695 
1705 
1715 
L725 
1739 
1749 
ATS.9 
1769 
EG) 
1801 
1811 
1821 
1831 
1841 
1851 
1865 
1875 
1885 
1895 
1905 
1915 
1933 
1943 
1953 
1963 
1973 
2115 
2125 
2135 
2149 
2159 
2169 
par 
7197 


335127H 
325647H 
3530256 
324711C 
242167F 
254515E 
301553D 
375627D 
2052378 
263003B 
2032078 
302131C 
245247B 
2473778 
324523H 
330023H 
251325A 
266745E 
255653F 
240233B 
263407F 
323113H 
342001C 
223043F 
355147D 
354503H 
330673H 
312411C 
342721G 
323145C 
327373D 
220433B 
324015C 
2454178 
321573D 
204141E 
212065A 
376475G 
310215G 
204235A 
244035E 
240741E 
215171A 
3265716 
351021G 
367701C 
321735C 
233215A 
354415C 
2266138 
221173B 
2273538 
370467H 
3226016 
344615C 
333221G 
3433356 
3311730 
2622710 
3426440 
3619716 
361055C¢ 
sorseic 
P1H109" 
ssgarr 


1339 
1353 
1363 
1373 
1383 
1393 
1403 
1417 
1427 
1437 
1447 
1457 
1467 
1481 
1491 
1501 
1511 
1521 
1555 
1565 
1575 
1585 
1595 
1609 
1619 
1629 
1639 
1649 
1659 
1677 
1687 
1697 
1707 
1717 
1731 
1741 
1751 
1761 
1771 
1781 
1803 
1813 
1823 
1833 
1843 
1853 
1867 
1877 
1887 
1897 
1907 
1925 
1935 
1945 
1955 
1965 
1975 
2117 
2127 
2137 
2151 
2161 
2171 
7189 
7199 


263 


354413H 
255113B 
340065G 
245025E 
243411A 
367671G 
352365G 
205273F 
317441G 
330543D 
245255E 
205423F 
323715C 
224725E 
302737D 
261765E 
203303F 
342177D 
224655A 
307563D 
307533D 
216551A 
252313B 
355513H 
225573F 
337577D 
271341E 
2124238 
214053B 
211767B 
277505E 
354231G 
264271A 
2121378 
363525C 
276117F 
300135C 
252015A 
210435E 
203603F 
261117B 
232435E 
343011G 
341523D 
330523H 
322643D 
303435G 
256353F 
316365C 
346145G 
205745E 
253215A 
350763D 
265101A 
372351C 
320151C 
300557D 
272425E 
363543D 
321433H 
2467214 
3230556 
292405F 
910003H 
PPTSIIA 















































264 


DEGREE 
2201 
2215 
Zea 
2235 
2249 
2259 
2269 
2283 
Zeve 
2319 
2329 
2343 
2353 
2363 
esr 
2387 
2397 
2411 
2421 
2439 
2449 
2459 
2473 
2483 
2493 
2507 
2oLy 
2531 
2581 
2595 
2605 
2615 
2629 
2639 
2649 
2663 
2673 
2695 
2705 
at ko) 
ete? 
2739 
2749 
2763 
2713 
2787 
2T9T 
2827 
2837 
2851 
2861 
2871 
2885 
2895 
2905 
eae 
2929 
2951 
2961 
297) 
2985 
2995 
3005 
3019 
3125 


16=-CONTINUED 


337027H 
203365A 
361437D 
2321778 
311763H 
206655A 
337647H 
347265C 
233251E 
253123B 
256731A 
364761C 
341121G 
272215A 
315017H 
372217H 
346757D 
335405G 
331145C 
2550178 
370115G 
367527H 
236547F 
312073H 
264673B 
366733H 
S35515C 
3540716 
314613H 
271547B 
$51731C 
3645770 
371607H 
250267F 
337225C 
224413F 
214125A 
2634254 
2112238 
356515C 
337457H 
371007D 
270263F 
342135C 
306227H 
350351C 
371253H 
000453 

231651E 
3252540 
355763H 
324001C 
376347D 
2255578 
330051C 
237765A 
224035E 
3654556 
344171C 
236407F 
BTISSLC 
205621A 
237651A 
3733356 
333171¢ 


2203 
2217 
2227 
2237 
2251 
2261 
2275 
2285 
2295 
Zoe. 
2331 
2345 
2355 
2365 
2379 
2389 
2403 
2413 
2423 
2441 
2451 
2461 
2475 
2485 
2499 
2509 
2519 
2533 
2583 
2597 
2607 
2617 
2631 
2641 
2651 
2665 
2675 
2697 
2707 
2717 
2031 
2741 
2735 
2765 
2775 
2789 
2799 
2829 
2839 
2853 
2863 
2873 
2887 
2897 
2907 
2924 
2931 
2953 
2963 
2973 
2987 
2997 
3011 
3021 
3127 


303417H 
306373D 
3123570 
303067H 
323627H 
374255C 
312763D 
2721614 
3744770 
235533F 
334423D 
332461C 
221603B 
364617D 
2716778 
200077F 
357451C 
254717F 
227305E 
374515G 
336675C 
20045 7F 
307775C 
260473B 
310527D 
3110616 
320407H 
233161A 
321247D 
SB2b5. 74 
305255C 
301737H 
2773278 
3521016 
245155E 
363343D 
215575A 
336623D 
201345E 
302415G 
246515E 
277461E 
253017B 
2736238 
350523D 
264111E 
312255C 
302151C 
S7STe1e 
3632270 
3120016 
2040138 
363657H 
3541756 
263461A 
254727F 
264721A 
243163F 
320775G 
353711C 
334565G 
207631A 
371105G 
2076136 
24064918 


2205 
2219 
2229 
2243 
2253 
2263 
2277 
2287 
Zouo 
2323 
2355 
2347 
2357 
Zor 
2381 
2391 
2405 
2415 
2425 
2443 
2453 
2467 
2477 
2487 
2501 
2511 
2521 
2535 
2585 
2599 
2609 
2619 
2633 
2643 
2653 
2667 
2677 
2699 
2709 
2723 
2733 
2743 
2757 
2767 
27 
2791 
2801 
2831 
2841 
2855 
2865 
2875 
2889 
2899 
2909 
2923 
2933 
2955 
2965 
2979 
2989 
2999 
3013 
4024 
9129 


202721A 
211213F 
340577D 
310107H 
220037B 
341233H 
334137D 
336013H 
000771 

217161E 
2TIGZIE 
2112 tr 
274077F 
267233F 
3454316 
2224438 
307413D 
344277D 
364553D 
362363H 
253521E 
236461E 
353001G 
275435A 
erirsso5 
323363D 
257345E 
370371C 
254373B 
317307H 
356625G 
251675A 
325437H 
207747B 
344337H 
361635C 
224161E 
3.75715G 
351533D 
363455G 
2277138 
253053F 
2567378 
367161G 
212641E 
366147H 
252203F 
345223H 
262721A 
371025C 
220747B 
351413D 
320437D 
23772 
224305E 
323267H 
221047F 
202013B 
27646 3B 
333345C 
373017H 
345145G 
253055E 
2TI6TIE 
2277978 


2211 
eeeL 
Zann 
2245 
2255 
2265 
2279 
2289 
2315 
2325 
2339 
2349 
2359 
2373 
2383 
2393 
2407 
2417 
2427 
2445 
2455 
2469 
2479 
2489 
2503 
2513 
2523 
2537 
2587 
2601 
2611 
2621 
2635 
2645 
2659 
2669 
2679 
2701 
2711 
2725 
2t35 
2745 
2759 
2769 
2779 
2793 
2803 
2833 
2843 
2857 
2867 
2877 
2891 
2901 
2915 
2925 
2935 
2957 
2967 
2981 
2991 
3001 
3015 
3121 
5131 


appendix C 


201165A 
326533H 
254513F 
342421C 
300741C 
227627B 
270127F 
310443D 
251037B 
256335A 
234037F 
374735C 
365573H 
366265C 
346365G 
255267F 
320365G 
215211E 
215135A 
347477D 
202045A 
356631C 
312507H 
200071E 
276265E 
3146156 
211327B 
301605G 
332231G 
303203D 
243771E 
275367F 
316451C 
251403B 
24201 7F 
221027B 
345101C 
247113F 
244745E 
363477D 
370125C 
243753B 
336615G 
237013B 
324513H 
300575C 
336007H 
311375G 
222535E 
232561E 
317271G 
255363B 
320317H 
216241A 
Seas 906 
3102570 
346231C 
334213H 
3144470 
375713H 
3667630 
247461E 
312078C 
235505E 
9111716 


2213 
222s. 
2233 
2247 
2257 
2267 
2281 
2291 
ZOLt 
2327 
2341 
2351 
2361 
AEM fe) 
2385 
2395 
2409 
2419 
2437 
2447 
2457 
2471 
2481 
2491 
2505 
rea: 
2525 
2539 
2589 
2603 
2613 
2627 
2637 
2647 
2661 
2671 
2681 
2703 
2713 
2727 
2737 
2747 
2761 
2732 
2781 
2795 
2805 
2835 
2845 
2859 
2869 
2883 
2893 
2903 
Sya0 
2927 
2937 
2959 
2969 
2983 
2993 
3003 
3017 
3123 
3141 


227107F 
344357D 
345363H 
255541A 
335513H 
260413F 
320055G 
233715E 
27153 0G 
210177F 
356031G 
303661G 
356613D 
306405C 
303255C 
307633D 
205757B 
244737F 
277136 
201241E 
364563D 
254643F 
222605A 
200275E 
235475A 
204567B 
306667D 
252455E 
350007D 
306645G 
266761A 
207733F 
343473D 
245057F 
343415C 
335661G 
314013H 
301365C 
261163F 
312253D 
313151C 
352363H 
2253190 
250565A 
202765A 
217635A 
254465A 
215121A 
3273230 
363557D 
2175278 
361027D 
241161E 
353265G 
304655G 
332017H 
336545C 
232233F 
251447F 
257253F 
2636416 
24366768 
3066756 
2202548 
397871C 





irreducible polynomials 


DEGREE 
3143 
3153 
3163 
3177 
3187 
3209 
3219 
3229 
3243 
3253 
3271 
3281 
3291 
3305 
3315 
3349 
3363 
3373 
3383 
3401 
3411 
3421 
3435 
3445 
3467 
3477 
3491 
3501 
3511 
3529 
3539 
3549 
3623 
3633 
3643 
3661 
3671 
3685 
3695 
3721 
3731 
3741 
3755 
3765 
3783 
3793 
3803 
3817 
3855 
4377 
4391 
4405 
4423 
4437 
4451 
4461 
4491 
4505 
4519 
4533 
4551 
4565 
4647 
4661 
4679 


16-—CONT INUED 


25323 7F 
220163B 
216545E 
320461C 
363057H 
26442 7F 
317675C 
370647H 
302267D 
202735E 
306313H 
241005A 
3561770 
367347D 
272535A 
252661A 
355067D 
265347F 
344227D 
370151G 
204007B 
363103H 
2265678 
233571A 
263 767F 
304503D 
231075E 
366117D 
327777H 
354767H 
266611E 
3277270 
2373 73F 
375225C 
354773H 
375555G 
230047F 
350435C 
2412678 
212033F 
262747F 
242161A 
242745A 
277065A 
232247B 
237435E 
226153F 
231057F 
000471 

205317B 
375041G 
310653D 
304757H 
2333278 
234111E 
3672670 
2313138 
371557D 
351757H 
274347B 
2354738 
3941230 
2911538 
2726935F 
27772 9F 


3145 
3155 
3165 
5279 
3189 
3241 
3221 
3235 
3245 
3235 
3273 
3283 
3293 
3307 
3341 
3351 
3365 
3375 
3385 
3403 
3413 
3427 
3437 
3447 
3469 
3479 
3493 
3503 
3513 
3531 
3541 
3555 
3625 
3635 
3653 
3663 
3673 
3687 
3697 
3723 
3733 
3747 
3757 
3767 
3785 
S195 
3805 
3819 
4369 
4379 
4393 
4407 
4425 
4439 
4453 
4467 
4493 
4507 
4521 
45395 
4554 
4567 
4649 
4665 
460) 


222215A 
202375A 
362243D 
3734070 
334041C 
305721G 
256577F 
376055C 
272353B 
2452778 
345257D 
243337F 
233321E 
223075E 
000551 

316671C 
217547B 
343.225C 
351T611C 
244377F 
226163F 
2t2aZzie 
277035E 
363255C 
214377F 
340731G 
300453H 
Be Me wile 
2154478 
332275C 
335061G 
243067B 
334371C 
2031738 
302033H 
305615C 
302451G 
377301C 
327623H 
360235C 
377465G 
3430630 
314531C 
206243F 
363367D 
337745C 
334603D 
340475C 
000023 

311121G 
237103F 
237501A 
2765738 
241773F 
200517F 
2356038 
244077F 
222231E 
339625¢ 
3451070 
9224916 
291165 
921524 
5176456 
9902716 


3147 
3157 
3171 
3181 
3191 
3213 
3223 
3237 
3247 
3257 
3275 
3285 
3299 
3309 
3343 
3353 
3367 
3377 
3387 
3405 
3415 
3429 
3439 
3449 
3471 
3481 
3495 
3505 
3515 
3533 
3543 
3613 
3627 
3637 
3655 
3665 
3675 
3689 
3699 
3T25 
3735 
3749 
3759 
3769 
3787 
3797 
3811 
3821 
4371 
4381 
4395 
4409 
4427 
4441 
4455 
4469 
4499 
4509 
4523 
45997 
4955 
4969 
4691 
466% 
4609 


316401C 
354565G 
332363D 
254637F 
204373F 
301167D 
220233F 
335343D 
270217B 
206225E 
345677D 
2205438 
206035E 
260011A 
225177F 
221123F 
240763F 
206151E 
230773B 
340605C 
350453D 
2173538 
305345G 
250131E 
213463B 
376125G 
227251A 
327163D 
240343B 
220075E 
210075A 
345251G 
355263D 
255125E 
2042538 
375653D 
206621A 
275747B 
216023B 
203311A 
SserveoG 
350031G 
343633D 
220607F 
271633F 
222377F 
334767H 
266635E 
207177B 
250201E 
267441A 
306043H 
332677H 
224707F 
311045¢C 
267135E 
3731256 
3515770 
3522316 
235167F 
s65401C 
220TTIA 
260279" 
94271990 
94027790 


3149 
3159 
3173 
3183 
3193 
3215 
3225 
3239 
3249 
3259 
3277 
3287 
3301 
3311 
3345 
3355 
3369 
3379 
3397 
3407 
3417 
3431 
3441 
3463 
3473 
3483 
3497 
3507 
3525 
3535 
3545 
3619 
3629 
3639 
3657 
3667 
3677 
3691 
3701 
3727 
3737 
3751 
3761 
3771 
3789 
3799 
3813 
3823 
4373 
4387 
4397 
4411 
4429 
4443 
4457 
4471 
4501 
4515 
4525 
4539 
4557 
467} 
4659 
4667 
4606 


343071G 
207227B 
305163H 
240255A 
240235E 
313577D 
340175C 
332751G 
2600278 
344023H 
347023H 
234537F 
277 257° 
272021E 
355233D 
300645C 
207441A 
371631G 
300367H 
316123H 
203175A 
313671G 
230333B 
366331G 
310633H 
324025C 
325167H 
323461C 
266461A 
302517D 
2205738 
245337F 
226741E 
304353D 
361445C 
252447F 
267227F 
271257F 
234337F 
237645E 
213727F 
231471E 
250407F 
223233B 
242321A 
360427H 
244021A 
324463H 
217565E 
254045E 
224173F 
317545G 
254211E 
356435C 
332707H 
367571C 
233231E 
3271170 
364715C 
3204230 
972421C 
219507F 
$14499¢ 
S22 147H 
S994470 


3151 
3161 
3175 
3185 
3207 
3217 
3227 
3241 
3251 
3269 
3279 
3289 
3303 
3313 
3347 
3357 
3371 
3381 
3399 
3409 
3419 
3433 
3443 
3465 
3475 
3485 
3499 
3509 
3527 
3537 
3547 
3621 
3631 
3641 
3659 
3669 
3683 
3693 
3703 
3729 
3739 
3753 
3763 
3781 
3791 
3801 
3815 
3825 
4375 
4389 
4403 
4421 
4435 
4445 
4459 
4489 
4503 
4517 
4531 
4549 
4563 
A645 
4659 
w67 
469) 


265 


205305E 
317631G 
344025C 
35 7641C 
S50375¢ 
207247F 
273513F 
340115G 
364473H 
202552 E 
SSS525¢ 
230415E 
350705C 
3353756 
242243F 
304161C 
3434016 
216755A 
254735A 
3464156 
340565G 
257325E 
271451E 
252755A 
232031A 
306551C 
346527H 
2T4&251E 
225073F 
217423B 
302555G 
257453B 
204613F 
257675E 
205723F 
302445C 
211201E 
336307D 
355645G 
2175638 
355727H 
310113D 
344543H 
301033H 
346517D 
247707B 
254133B 
275675A 
214467B 
270271A 
252227B 
264727F 
310723D 
227611A 
323671G 
375113H 
323365C 
316767H 
322301G 
377351G 
23227768 
3344370 
PIBLIIA 
921258C 
possose 


























266 


DEGREE 
4693 
4707 
4717 
4755 
4765 
4779 
4793 
4811 
4825 
4839 
4885 
4899 
4909 
4923 
4941 
4955 
4969 
5003 
5017 
5031 
5205 
5219 
$229 
5267 
5208 
5291 
5305 
5331 
5341 
5355 
5405 
5419 
5433 
5459 
5469 
5483 
SSrT 
5531 
5545 
5559 
5581 
5687 
5709 
5723 
5737 
5779 
5789 
5803 
5817 
5843 
5853 
5SL4 
5925 
5939 
6345 
6359 
6425 
6443 
6457 
6483 
6501 
6515 
6553 
6571 
6585 


16=-CONTINUED 


3404316 
2244578 
330741G 
2705738 
231221A 
232441A 
357173H 
363623D 
364321C 
316053D 
2412078 
366471C 
255737F 
357321C 
312477D 
344507D 
366447H 
365753H 
335447H 
230005A 
345611 
353073D 
200617B 
313743H 
341727D 
362113H 
203773B 
237205A 
216427F 
232531A 
372211C 
367257H 
264 705A 
315757H 
2325078 
221743F 
2161278 
204657F 
262507B 
226007B 
223531E 
271317F 
367053D 
273127F 
217173F 
244773F 
334215G 
216141E 
201323B 
206363F 
236665A 
000435 
325617D 
231433F 
220551A 
230731E 
000637 
257255A 
243441E 
2165138 
365325C 
221425A 
222527F 
253653F 
3266470 


4695 
4709 
4723 
4757 
4771 
4781 
4795 
4813 
4827 
4841 
4887 
4901 
4915 
4933 
4947 
4957 
4971 
5005 
5019 
5033 
5207 
5221 
5235 
5269 
5283 
5293 
5319 
5333 
5347 
5397 
5411 
5421 
5447 
5461 
5475 
5485 
5523 
5533 
5547 
5561 
5587 
5689 
5715 
5725 
5739 
5781 
5795 
5805 
5831 
5845 
5859 
5913 
5927 
5941 
6347 
6361 
6427 
6445 
6471 
6485 
6503 
6541 
6555 
6573 
6599 


300247D 
305343D 
311465G 
371203H 
267177F 
241413F 
307457D 
367767H 
212131A 
216523F 
21 on77B 
3526556 
211527B 
301571G 
244107B 
361505G 
220265A 
340751C 
2652754 
243703F 
373065G 
230303F 
252315A 
372727H 
254753B 
261217F 
200767B 
246753F 
246551E 
000567 
302751G 
222451A 
254615E 
206745E 
334665C 
$7$$11¢ 
264051A 
360177H 
2115538 
304137H 
332125G 
201615E 
374331C 
2754638 
3563430 
217305A 
S377 7S¢ 
267607B 
355755C 
334451C 
235743B 
255021A 
363007H 
304457H 
325303H 
322405G 
341575G 
301767D 
315641C 
352303D 
336763H 
223755E 
215061A 
ST7375¢ 
2701393F 


4697 
4711 
4725 
4759 
4773 
4787 
4805 
4819 
4829 
4843 
4889 
4903 
4917 
4935 
4949 
4963 
4973 
5011 
5021 
5035 
5209 
5223 
5237 
5271 
5285 
5299 
S82% 
5335 
5349 
5399 
5413 
5427 
5449 
5463 
5477 
5491 
5525 
5539 
5549 
5575 
5677 
5703 
5717 
5731 
5741 
5783 
S797 
5811 
5833 
5847 
5861 
5915 
5929 
5943 
6349 
6363 
6437 
6451 
6473 
6487 
6505 
6547 
6565 
6579 
6601 


272647F 
354505G 
317765C 
347277H 
365433D 
221527F 
263745A 
261545E 
306711G 
245717F 
371623H 
311705G 
352275C 
202543B 
345443H 
231235E 
265653F 
302605G 
260167F 
363433D 
333551G 
317703D 
203761E 
350471C 
265003B 
236443F 
2342178 
364757D 
203577B 
356433H 
370257H 
347323D 
242635E 
230173B 
216351E 
3567170 
360755C 
302541G 
246747F 
2663638 
263431E 
242173B 
261227F 
226171E 
223705E 
236715E 
205341A 
263503B 
371177H 
362317D 
242633F 
230267B 
203571E 
247553B 
306747H 
362731C 
376677H 
333075G 
241577F 
210711E 
3735470 
256621E 
366625C 
262015A 
3405216 


4699 
4713 
4747 
4761 
4775 
4789 
4807 
4821 
4835 
4845 
4891 
4905 
4919 
4937 
4951 
4965 
4979 
5013 
5027 
5037 
5211 
5225 
5259 
5273 
5287 
5301 
5323 
5337 
5351 
5401 
5415 
5429 
5451 
5465 
5479 
5493 
5527 
5541 
5555 
5577 
5683 
5705 
5719 
5733 
5747 
5785 
5799 
5813 
5835 
5849 
5863 
5917 
5931 
5945 
6355 
6373 
6439 
6453 
6475 
6489 
6507 
6549 
6567 
6581 
6603 


appendix C 


250641E 
250377B 
206723F 
374567D 
334401C 
204471E 
375603H 
3215370 
235237B 
267755A 
313167H 
275177B 
245711E 
360067H 
213233F 
2607578 
376663H 
316475C 
255707F 
304327D 
234501A 
2111078 
332201C 
347247H 
255425A 
2757538 
232513F 
235257B 
201643F 
254453F 
364627D 
342501G 
311031C 
263201A 
340363H 
272663B 
310503H 
241443B 
307251C 
261613B 
235125E 
223763B 
220121E 
372241C 
215657F 
253251A 
345021C 
353315G 
S3212395C 
273645E 
273075E 
210763F 
343725C 
257023B 
377241C 
247527F 
204337F 
213765A 
330255C 
210241A 
304115C 
210471A 
3765630 
241119F 
290445) 


4701 
4715 
4749 
4763 
4777 
4791 
4809 
4823 
4837 
4883 
4893 
4907 
4921 
4939 
4953 
4967 
4981 
5015 
5029 
5203 
5213 
5227 
5261 
5275 
5289 
5303 
5325 
5339 
5353 
5403 
5417 
5431 
5453 
5467 
5481 
5515 
5529 
5543 
5557 
S879 
5685 
5707 
5721 
5735 
5773 
5787 
5801 
5815 
5837 
5851 
5865 
5923 
5933 
6343 
6357 
6375 
6441 
6455 
6477 
6491 
6509 
6551 
6569 
6563 
6709 


B22771C 
2326378 
211521A 
226343F 
3736770 
357511C 
322165C 
201561E 
352677H 
000543 

300515C 
337137H 
372447H 
276323F 
236371A 
245023F 
235273B 
345053D 
226373F 
202051E 
346751G 
2333595 
211363F 
230145A 
305153D 
322375G 
234601A 
212257F 
302021G 
263027B 
210117F 
233033F 
250555E 
312703H 
306271C 
3757070 
2307438 
354517H 
225411E 
347441G 
301035C 
273031E 
235611A 
250663B 
252513F 
3061770 
22701 7F 
3653670 
221223F 
374361G 
3265530 
321717H 
220045A 
3776456 
3724330 
3525270 
234241A 
2712078 
3607340 
254075E 
331617 
377203 
262227F 
216597F 
370719" 





irreducible polynomials 


DEGREE 
6711 
6733 
6747 
6765 
6811 
6829 
6855 
6869 
6939 
6957 
6983 
6997 
7015 
9365 
9395 
9429 
9523 
9557 
9619 
9645 
9819 
9893 

10571 
10645 
10931 
10965 
11083 
11565 


DEGREE 
9 
19 
29 
39 
49 
59 
69 
os) 
89 
99 
109 
119 
129 
139 
149 
159 
169 
179 
189 
199 
209 
219 
229 
239 
249 
259 
269 
279 
289 
299 
309 
319 
329 
339 
Uh) 


16--CONT INUED 


375261C 
372545G 
3564170 
301145C 
335025G 
252765E 
303075C 
277457F 
000643 

2753438 
272225E 
315467H 
2775638 
316027D 
245043B 
245147B 
276277F 
221505E 
314777H 
322717D 
201263B 
372323H 
320157H 
241125A 
2117378 
220411A 
204325E 
000727 


17 
410117F 
403555E 
466273F 
414443F 
535013F 
626653H 
422273F 
561175E 
532617F 
601335G 
506741E 
735207H 
671075G 
402545E 
461331E 
430053F 
521367F 
424107F 
470147F 
722571G 
674557H 
706353H 
435251E 
734727H 
705503H 
4T7T7T43F 
41 7611E 
501275E 
476601E 
461471E 
6674016 
472617F 
5046410 
60927056 
AO55P10 


6713 
6739 
6757 
6803 
6821 
6835 
6857 
6871 
6949 
6963 
6985 
6999 
7017 
9371 
9397 
9435 
9525 
9563 
9621 
9651 
9829 
9899 
10573 
10667 
10933 
11051 
11085 
13107 


1 
11 
21 
EI 
41 
51 
61 
71 
81 
31 

101 
pha igh 
12h 
131 
141 
151 
161 
171 
181 
191 
201 
211 
221 
231 
241 
251 
261 
271 
281 
291 
30) 
$11 
S21 
341 
“1 
41 


242371E 
341711G 
352457H 
343565G 
353427H 
273421A 
315065G 
326701G 
2123728 
355465C 
2341178 
355331C 
352437D 
255161E 
236503F 
300403D 
225361A 
241201E 
256055A 
2605414 
262453F 
273433F 
204645E 
264323F 
362553H 
000537 

253401A 
000037 


400011E 
400731E 
525327F 
642015G 
501353F 
610215G 
405473F 
442571E 
447773F 
537773F 
606155G 
514045E 
662527H 
443043F 
547163F 
454433F 
83:75:1 7F 
743537H 
675215G 
41355 7F 
600657H 
630043H 
751471G 
620071G 
740227H 
763237H 
477633F 
404121€ 
44601 7F 
4I7T691E 
591071 
62593216 
S1i1l997F 
“25600108 
Si22110 
640H0TH 


6727 
6741 
6759 
6805 
6823 
6837 
6859 
6873 
6951 
6965 
6987 
7001 
7019 
9381 
9419 
9509 
9547 
9573 
9627 
9805 
9835 
9901 
10579 
10837 
10955 
11053 
11443 
21845 


3 
13 
23 
33 
43 
53 
63 
73 
83 
93 
103 
It3 
123 
133 
143 
153 
163 
173 
183 
193 
203 
213 
223 
233 
243 
253 
263 
273 
263 
293 
503 
415 
925 
44 
45 
4995 


345425G 
223155A 
3775370 
232661A 
251543F 
350601C 
245165E 
304017D 
360253D 
240367B 
264073B 
263161E 
217317F 
267357B 
257067F 
000515 

354407H 
235731A 
312545¢ 
310751C 
2657578 
360463H 
314043H 
317515G 
275221A 
242341E 
254331E 
000007 


400017F 
411335E 
411077F 
446613F 
445141E 
403063F 
504671E 
612537H 
470337F 
510473F 
540041E 
750413H 
530645E 
607115G 
742377H 
724003H 
652243H 
424443F 
541625E 
424761E 
554347F 
734763H 
636031G 
752045G 
633051G 
544613E 
755723H 
S21531E 
671763H 
404607F 
772047 
S1007I1E 
SLIS7OF 
466055 
715147" 
655007" 


6729 
6743 
6761 
6807 
6825 
6839 
6861 
6875 
6953 
6967 
6989 
7003 
7021 
9387 
9421 
9515 
9549 
9579 
9637 
9811 
9877 
9907 
10581 
10923 
10957 
11059 
11469 


) 
Ls 
25 
35 
45 
$$ 
65 
75 
85 
35 
105 
zis 
12s 
Bly: | 
145 
155 
165 
175 
185 
LYS 
205 
ere 
225 
235 
245 
255 
265 
275 
285 
295 
505 
$15 
$25 
s95 
TAS 
945 


363411C 
250353F 
342575G 
237211A 
325327D 
324657H 
217275A 
244365A 
305051C 
242767F 
304633H 
314057H 
267601A 
307143D 
200641E 
322315C 
262433B 
2760578 
223203F 
304773H 
260243B 
365637H 
366135¢C 
247167B 
323305G 
240747F 
234133B 


400431E 
444257F 
404525E 
527427F 
663013H 
530765E 
771353H 
572325E 
640635G 
413651E 
525535E 
642433H 
431601E 
432265E 
430161E 
562467F 
455655E 
421215E 
771231G 
656765G 
543457F 
402253F 
755535G 
742003H 
676521G 
524057F 
447503F 
611073H 
455647F 
466457F 
477225E 
579213F 
609777H 
5657650 
saree 
sonar 


6731 
6745 
6763 
6809 
6827 
6841 
6867 
6885 
6955 
6969 
6995 
7013 
9363 
9389 
9427 
9517 
9555 
9581 
9643 
9813 
9883 
9909 
10603 
10925 
10963 
11061 
11475 


17 

27 

ST 

47 

57 

67 

cm: 

87 

oT 
107 
Lit 
127 
137 
147 
157 
167 
177 
187 
197 
207 
217 
227 
ant 
247 
257 
267 
277 
287 
avT 
307 
317 
327 
so7 
say 
oo” 


267 


275661E 
251435A 
373773H 
330307H 
224505E 
ZIOZSSE 
3521370 
321613D 
361063D 
267625A 
304713D 
357145G 
342631C 
3653456 
235011E 
261153F 
244611A 
335203H 
347127H 
335601C 
217603F 
263071A 
360515G 
312537D 
265773F 
343555C 
340407D 


525251E 
600013H 
401523F 
414347F 
414663F 
460377F 
444611E 
564225E 
646775G 
514573F 
714303H 
551757F 
775325G 
454067F 
504505E 
774563H 
727113H 
655241G 
734703H 
756341G 
414115E 
542447F 
771451G 
717553H 
567321E 
774503H 
411347F 
432625E 
575245E 
652563H 
457601E 
755547H 
424505E 
545604F 
5651718 
S7TO8968 























268 
DEGREE 18 1 
7 10003778 9 
15 1015721A 17 
27 1223215A 63 
189 1623075C 57 
57 1160435A ge | 
399 1514245C 399 
1197 1052465A L197 
219 1252555A 657 
657 1253607A 1971 
1533 1055321A 4599 
4599 1341035A 13797 
DEGREE 19 1 
7*2570103F 9 
15 233106 7F 17 
DEGREE 20 1 
7 4001051E 9 
15 42210378 i 
25 4307165A 75 
165 51452178 55 
825 6044073D 31 
465 5057137B 153 
2325 4504241A 341 
5115 5327265A 1705 
25575 6647133D 41 
615 7113055C 205 
1353 76027770 2255 
6765 5521623B 1271 
19065 7164555C 6355 
41943 4102041A 
DEGREE 21 1 
 YTLLITISA 9 
15 10050335E LT 
49 11105347A 127 
6223 17155161C Sot 
42799 10040001A 
DEGREE 22 iu 
7 22222223F 9 
15 201105178 a 
23 20005611A 69 
2047 22404051A 6141 
60787 34603145C 
DEGREE 23 1 
7 40010061E 9 
15 40405463F it 
47 44636045A 178481 
DEGREE 24 
5 100305143B 
11 125245661E 
17 140775753D 
45 170736335C 
105 151255377B 
39 156267123C 
65 1500517470 
585 157653375C 
273 137240727A 
1365 1034463414 
51 155212435A 
85 141720423¢ 


1000201E 
1200205A 
1115701E 
1313133B 
1160435A 
1626367D 
1514245C 
1052465A 
1253607A 
1334325A 
1341035A 
17777770 


2000047F 
2561427F 
3146455G 


4000011E 
4040217B 
6000031G 
4266075A 
4346037B 
40347554 
4367471A 
4510031A 
6406005C 
4027577B 
5541427A 
5017111A 
7050457D 
6130725C 


10000005E 
10040315E 
10002135E 
10225077A 
10264425A 


20000003F 
20100453B 
20430607F 
20465307B 
36544657D 


40000041E 
50000241E 
40103271E 
43073357B 


13 
19 
63 
105 
39 
195 
91 
819 
1365 
51 
255 


11 
19 
63 
57. 
171 
Ligh 
73 
219 
511 
1533 
1387 


11 
19 


11 
Pe 
33 
165 
93 
465 
1023 
2195 
123 
615 
6765 
Stra 
19065 


LD 
19 
889 
2359 


1% 
19 
89 
683 


3 
11 
19 


1010301A 
1703601G 
1023141A 
1313133B 
1160435A 
1626367D 
1052465A 
1642365C 
1252555A 
1231145A 
1055321A 
1011011A 


2020471E 
2227023F 
3610353H 


40000178 
4030071A 
4442235E 
40362678 
51452178 
4627377B 
5057137B 
7552557D 
5327265A 
4761757B 
7113055C 
5521623B 
4345543B 
7164555C 


10040205E 
10000635E 
17000075G 
11166743A 
16260075C 


20100403B 
25200127F 
20070217F 
20603715A 
34230073D 


40404041E 
40220151E 
41224445E 


100000207F 
100315361A 
113646571A 
113763063E 
164260065C 
151255377B 
156267123C 
132365525A 
1605035630 
144534331C 
1034469414 
155212495A 
172694807C 


appendix C 


5 1002241E 

13 1025711E 
21 10704778 
63 1313133B 
171 16263670 
133 1300565A 
399 1514245C 
219 1252555A 
657 1253607A 
1533 1055321A 
4599 1341035A 
9709 1001001A 


5 2013211E 


13 2001 72EE 


2 


1 2766447F 


5 4200031A 


13 4004515E 
21 4103307B 
55 43460378 
275 6027135C 
155 4367471A 
775 6505453D 
1705 6406005C 
8525 5746331A 


205 5541427A 


45 


1 75442370 


2255 5017111A 


635 
1398 


13 
ou 
889 
2359 


13 

21 
267 
15709 


13 
21 


15 
21 
35 
319 
Udy 
195 
273 
455 
4095 
154 
255 


5 6130725C 
1 4100001A 


10020045E 
10103075E 
14600067D 
11166743A 
16260075C 


20001043F 
20401207F 
314001470 
241464778 
217744138 


40000063F 
400063416 
404356516 


100205645A 
102746675A 
11243227368 
116636645A 
113206017A 
1054046476 
1313074438 
132365525A 
13724072TA 
1653303270 
120652605A 
1906939278 
172694907C 





irreducible polynomials 


DEGREE 24={-CONTINUED 
765 146537231C 
357 105732145A 
1785 121720647B 


220 
1989 
3315 
4641 
7735 

69615 

T23 

3615 


100466513A 
101312015A 
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